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^  A  special  class  of  closed-loop  systems  composed 
of  a  controller  and  observer  in  cascade  are  analyzed. 
The  plant  dynamics-  are  assumed  to  be  linear  and  time- 
varying  but  the  system  parameters  are  uncertain.  The 
class  of  observation  functions  is  restricted  to  those 
that  can  be  transformed  into  a  linear  structure  in  the 
state  called  pseudo- 1  inear  measurements  where  the  coef¬ 
ficient  may  be  an  explicit  function  of  the  original 
measurements.  If  along  a  given  path  the  state  vector  is 
observable,  then  the  estimation  error  of  a  linear  ob¬ 
server  structure  can  be  shown  to  be  asymptotically 
stable.  The  emphasis  is  on  deriving  and  analyzing  gen¬ 
eral  Lyapunov  functions  which  indicate  system  stability 
or  a  measure  of  system  performance  under  parameter  vari- 
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ations.  The  first  Lyapunov  function  is  ^  developed  by 
combining  the  separate  controller  and  observer  Lyapunov 
functions,  both  of  which  are  quadratic.  This  combined 
Lyapunov  function  is  not  valid  for  all  linear,  time- 
varying,  closed-loop  systems."  However,  the  weightings 
in  the  controller  performance  index  are  scaled  such  that 
the  combined  Lyapunov  function  is  valid  for  these  sys¬ 
tems.  Further,  this  Lyapunov  function  provides  a  means 
for  developing  a  more  stable  system  through  an  overall 
design  selection  of  the  controller  and  observer  parame¬ 
ters. 


A  second  Lyapunov  function  is  derived  to  account 
for  the  system  where  the  controller  is  a  function  of  the 
estimated  states.  This  Lyapunov  function  is  valid  for 
linear,  time-varying,  closed-loop  systems. 


A  third  Lyapunov  function  is  derived  to  directly 
account  for  parameter  uncertainties  in  the  system  model. 
This  Lyapunov  function  is  very  useful  in  identifying 
system  instabilities,  given  system  parameter  variations. 
All  three  Lyapunov  functions  are  valid  for  linear, 
time-varying,  and  certain  classes  of  nonlinear  systems. 
For  linear,  time-varying,  finite-time  problems,  the 
Lyapunov  function  derived  for  system  parameter  varia¬ 
tions  is  used  to  provide  a  measure  of  system  performance 
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given  these  system  variations.  This  Lyapunov  function 
is  also  used  to  provide  a  measure  of  system  performance 
for  the  homing  missile  guidance  problem. 


A  new  control  law  is  developed  to  improve  the 
performance  of  the  pseudomeasurement  observer  in  the 
guidance  loop.  The  control  law  is  developed  from  linear 
quadratic  Gaussian  theory  to  minimize  the  final  relative 
position  states  and,  in  addition,  improve  the 
psuedomeasur ement  observer's  performance  by  increasing 
the  observability  Grammian  matrix.  Because  of  the  linear 
quadratic  nature  of  the  problem,  a  closed-form  solution 
is  obtained.  The  performance  gain  is  measured  by  the 
Lyapunov  function. 
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SECTION  I 


INTRODUCTION 

1 . 1  Background 

The  focus  of  this  research  is  in  two  areas.  Tne 
first  part  is  to  develop  a  means  of  analyzing  the  per¬ 
formance  of  closed-loop  systems  with  an  observer  in  the 
feedback  loop,  providing  state  estimates  to  the  control 
law.  Particular  emphasis  is  placed  on  the  homing  mis¬ 
sile  guidance  problem.  For  this  class  of  problems,  the 
observer  is  nonlinear  [109,129].  The  second  part  is  to 
use  the  information  provided  from  the  stability  analysis 
to  design  a  better  guidance  law. 

1.1.1  Stability  k n a  1 v s i s 


For  linear,  time- invar iant  systems,  the  eigen¬ 
values  of  the  system  matrix  can  be  used  to  determine 
stability.  For  continuous-time  systems,  the  eigenvalues 
of  the  system  matrix  must  have  negative  real  parts  for 
the  system  to  remain  stable.  For  d isc r e te- time  systems, 
the  eigenvalues  of  the  state  transition  matrix  must 
remain  within  tne  unit  circle  for  the  discrete  system  to 


remain  stable. 


For  linear,  time-varying  systems,  eigenvalue 
analysis  may  not  provide  useful  information.  It  is  pos¬ 
sible  for  the  closed-loop  system  to  be  unstable  even  if 
all  the  eigenvalues  have  negative  real  parts  for  all 
t  _>  tg.  It  is  also  possible  for  the  system  to  be  asymp¬ 
totically  stable  even  if  all  the  eigenvalues  of  the 
closed-loop  system  matrix  are  constant  and  some  have  po¬ 
sitive  real  parts  [139]. 

There  have  been  efforts  to  apply  eigenvalue 
analysis  to  certain  classes  of  linear,  time-varying  sys¬ 
tems.  Rosenbrock  [110]  investigated  linear,  time- 
varying  systems  in  which  the  rate  of  change  of  the 
time-varying  elements  of  the  system  matrix  were  suffi¬ 
ciently  small.  He  was  able  to  obtain  explicit  bounds 
for  the  time-varying  elements  where  in  the  system  would 
remain  stable.  His  study  was  limited  to  system  matri- 
cies  mat  were  in  canonical  form. 

In  a  more  recent  study,  Wu  [139]  has  developed  a 
means  of  determining  the  necessary  and  sufficient  condi¬ 
tions  for  the  asymptotic  stability  of  linear,  time- 
varying  systems.  His  work  involves  the  concept  of  mode 
vectors.  Wu  defines  mode  vectors  in  terms  of  the  ex¬ 
tended  eigenpairs  (tne  extended  eigenvalues  and  the  ex¬ 
tended  eigenvectors)  of  tne  time-varying  system  matrix. 

For  nonlinear,  closed-loop  systems,  eigenvalue 


3 


analysis  involves  linearizing  the  system  about  some  non¬ 
singular  operating  point.  This  can  be  useful  for  sys¬ 
tems  with  small  nonlinearities;  however,  the  stability 
analysis  is  only  valid  in  an  arbitrarily  small  region 
about  the  point  of  linearization. 

[  A  stability  analysis  concept  which  has  received 

much  attention  is  Lyapunov's  stability  theory.  The 
theory  can  be  applied  to  the  class  of  linear  systems  and 
I  certain  classes  of  nonlinear  systems ,  as  well  as  certain 

classes  of  stochastic  systems.  Given  x ( t ) ,  an  n- 
dirensional  vector,  and  an  initial  time,  t^,  define 
x  (t)  to  be  the  nominal  x(t)  .  xn(t)  stable  in  the 

sense  of  Lyapunov  if  to  each  -O0,  there  corresponds  a 
region  b(«,tg),  such  that  for  any  solution,  x  (tfl), 
whose  distance  from  x(t  is  d  [  x„  ( t  „ )  ,  x  ( t„  )  ]  <b  ,  then 
d  [  x^  ( t)  ,x  ( t)  ]  <<  for  all  t>_t„  [38].  This  is  known  as 

Lyapunov's  first  method  and  is  applicable  only  in  a 
small  region  near  the  singularity  [38].  This  will  be 
discussed  in  more  detail  in  Section  II. 

A  useful  approach  to  determining  system  stabili¬ 
ty  is  the  second  method  of  Lyapunov  (or  the  direct 
method) .  This  method  involves  the  selection  of  a  gen¬ 
eralized  scalar  potential  function,  called  a  Lyapunov 
function.  Tne  selected  Lyapunov  function  is  tested  for 
certain  conditions  that  denote  stability.  Lyapunov 
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functions  are  not  unique  for  any  particular  system,  and 
can  be  difficult  to  obtain  for  some  systems.  In  addi¬ 
tion,  the  second  method  of  Lyapunov  is  only  a  sufficien¬ 
cy  test  for  stability.  The  significance  of  this  point 
is  a  candidate  Lyapunov  function  that  doesn't  satisfy 
the  stability  conditions,  does  not  provide  any  informa¬ 
tion  concerning  system  stability.  This  means  that  a 
different  candidate  function  is  needed  for  the  Lyapunov 
analysis.  However,  if  a  valid  Lyapunov  function  can  be 
found,  this  method  provides  a  powerful  stability- 
analysis  tool  . 


The  application  of  Lyapunov's  second  method  to 
linear  feedback  control  systems  and  estimation  algo¬ 
rithms  has  received  much  attention  [17,101].  Moore  and 
Anderson  [101]  analyzed  the  stability  properties,  via 
Lyapunov's  second  method,  for  the  linear,  discrete-time 
optimal  regulator  problem.  In  the  same  paper,  they 
developed  the  stability  characteristics  of  a  linear  es¬ 
timator.  However,  the  state  estimates  are  not  used  in 
any  way  in  the  closed-loop  control  systems.  Song  and 
Speyer  [119,120]  applied  Lyapunov’s  second  method  to  a 
class  of  nonlinear  estimation  algorithms  which  are  of 
the  modifiable  type.  Modifiable  implies  that  the  non- 
linearities  in  either  the  system  dynamics  or  measurement 
model  can  be  manipulated  into  a  linear  function  of  the 
states. 


The  application  of  Lyapunov's  second  method  to 
analyzing  the  stability  of  closed-loop  control  systems 
containing  an  observer  in  the  control/feedback  loop  has 
received  very  little  attention.  In  a  recent  paper  by 
Geering  and  Basar  [49],  a  Lyapunov  function  is  identi¬ 
fied  for  the  standard  linear  quadratic  regulator  problem 
with  a  linear,  full-order  state  observer.  They  identi¬ 
fied  a  Lyapunov  equation  for  this  system  and  used  the 
solution  in  a  cost  functional  of  the  form 
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J  =  q  vq 


(1.1) 


where 
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(1.2) 


and  x  is  the  true  state  and  e  is  the  observer  error. 
This  Lyapunov  function  is  used  to  snow  that  the  linear 
quadratic  regulator  problem  has  a  superior  control  gain 
for  every  arbitrary  choice  of  the  observer  gain  if  and 
only  if  the  observer  is  initialized  with  the  true  state 
[49]  . 


The  stability  analysis  of  closed-loop  systems 
with  observers  in  the  loop  is  a  very  important  issue 
since,  in  most  realistic  environments,  the  full  true 
state  information  will  not  be  available  for  t.ne  control 
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law.  The  certainty  equivalence  principle  [39]  is  the 
basis  for  combining  the  separately  designed  optimal  con¬ 
troller  and  optimal  estimator  into  a  cascaded  optimal 
feedback  control  system.  Given  this,  is  it  possible  to 
say  that  the  combination  of  the  Lyapunov  functions 
designed  for  the  separate  controller  and  the  observer 
provides  a  valid  Lyapunov  function  for  the  cascaded  sys¬ 
tem?  If  so,  this  would  be  an  important  result,  since 
much  is  known  about  the  Lyapunov  function  for  the  linear 
regulator  problem  and  for  the  linear  (or  modifiable  non¬ 
linear)  observer  problem.  Studies  by  Anderson  and  Moore 
[5]  and  Song  and  Speyer  [119,120]  have  shown  that  valid 
Lyapunov  functions  exist  for  the  regulator  and  the 
observer,  separately.  If  the  combined  Lyapunov  func¬ 
tions  are  valid  for  the  cascaded  system,  then  the 
closed-loop  system  with  the  observer  in  the  loop  is 
stable  when  the  reculator  is  stable  and  t.ne  observer  is 
stable.  For  linear,  time- invar iant  systems,  eigenvalue 
analysis  provides  the  same  results.  If  the  cascaded 
Lyapunov  function  is  valid,  one  can  make  the  same  types 
of  claims  for  linear,  time-varying  systems,  and  certain 
classes  of  nonlinear  systems. 

If  the  combination  of  the  two  separate  Lyapunov 
functions  is  valid  for  the  closed-loop  system,  is  it  the 
best  possible  choice  for  this  system  in  terms  of  identi¬ 
fying  system  stability?  if  not,  is  there  a  better 


Lyapunov  function  for  the  closed-loop  system, 
issues  are  the  basis  for  this  research. 


These 


In  addition,  if  Lyapunov  functions  can  be  found 
for  these  cascaded  systems,  can  they  be  put  to  some 
practical  use  in  analyzing  stability?  For  instance,  can 
they  be  used  to  determine  the  effects  of  parameter  vari¬ 
ations  on  the  stability  of  a  system  over  a  wide  range  of 
parameter  changes?  If  not,  can  a  more  sensitive 
Lyapunov  function  for  the  cascaded  system  be  determined? 
This  is  one  issue  which  is  addressed  in  this  research. 
In  this  study,  the  Lyapunov  functions  are  derived  for 
the  cascaded  controller  ,/fil  ter  system;  however,  the 
results  are  based  on  noiseless  measurements  so  that  the 
filters  can  be  considered  as  observers.  In  addition, 
since  the  effort  concentrates  on  the  homing  missile 
problem  (which  is  a  nonlinear,  time-varying,  finite-time 
problem) ,  tne  Lyapunov  functions  are  used  to  provide  a 
measure  of  performance  of  the  system. 

1.1.2  Stability  o  f  Closed- loop  Systems  Under  Parameter 
Variations 

In  the  process  of  designing  feedback  control 
systems  and  estimation  algorithms,  certain  assumptions 
are  made.  One  of  tne  most  important  assumptions  is  that 


the  parameters  in  the  model  of  the  dynamics  and  tne 


measurement  device  are  accurate  representations  of  the 
true  system.  If  this  is  not  true,  the  control  and  esti¬ 
mation  algorithm  are  no  longer  optimal.  In  fact,  it  is 
possible  for  the  closed-loop  system  to  be  unstable 
depending  on  how  large  the  errors  are  in  these  parame¬ 
ters.  Speyer  [122]  investigated  the  stability  charac¬ 
teristics  of  linear  time- invar ian t  systems  with  the 
estimation  algorithm  in  the  loop  given  that  parameter 
variations  exist.  Given  the  dynamic  models  of  the  con¬ 
trol  system  and  the  filter  algorithm,  he  restructured 
the  algorithms  to  emphasize  the  modelling  errors.  Then, 
given  the  steady  state  closed-loop  system  matrix,  he 
determined  the  range  of  parameter  variations  for  which 
the  real  part  of  the  eigenvalues  of  the  system  matrix 
remain  negative;  and  thus,  maintaining  system  stability. 
Speyer  was  able  to  identify  a  range  of  acceptable  varia¬ 
tions  in  the  system  parameters  for  which  the  system 
remained  stable.  This  type  of  study  provides  some  very 
useful  information  for  the  design  of  control  and  estima¬ 
tion  algorithms;  however,  as  pointed  out  in  the  previous 
section,  the  eigenvalue  analysis  is  only  useful  for 
linear  time  invariant  problems. 

Kalman  and  Bertram  considered  the  idea  of  using 
the  Lyapunov  function  to  determine  the  effects  of  param¬ 
eter  variations  [70].  Their  study  was  based  on  the  idea 
that  without  parameter  variations,  the  Lyapunov  function 
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is  positive  definite  and  its  derivative  is  negative 
definite.  Tnen,  by  introducing  a  parameter  variation 
term  in  the  systems  dynamics,  it  is  be  possible  that  the 
derivative  of  the  Lyapunov  function  might  not  be  nega¬ 
tive  definite  for  certain  ranges  of  values  of  varia¬ 
tions.  The  same  concept  was  applied  by  Song  and  Speyer 
[ 119,120 ]  to  a  nonlinear  (modifiable)  estimation  algo¬ 
rithm. 

Another  aspect  of  this  research  is-  to  investi¬ 
gate  the  usefulness  of  Lyapunov  stability  theory  for 
linear,  time-varying  and  certain  classes  of  nonlinear 
systems  given  these  variations  in  parameters.  Again, 
this  effort  focuses  on  the  identification  of  a  valid 
Lyapunov  function.  Once  a  Lyapunov  function  exists  for 
the  cascaded  system,  can  it  be  used  to  determine  stabil¬ 
ity  characteristics  of  the  system  when  the  true  system 
parameters  deviate  from  tne  assumed  system  parameters? 
If  the  Lyapunov  function  for  the  cascaded  system  is  not 
valid  when  considering  parameter  variations,  can  another 
Lyapunov  function  be  derived  which  will  better  measure 
the  stability  or  performance  of  the  system  when  parame¬ 
ter  variations  exist? 

There  are  four  main  objectives  of  this  disserta¬ 
tion,  wnirh  relate  to  Lyapunov  theory.  The  first  objec¬ 
tive  is  to  determine  if  the  combination  of  the  separate 


controller  and  observer  Lyapunov  functions  represent  a 
valid  Lyapunov  function  for  the  controller/observer  cas¬ 
caded  system.  The  second  objective  is  to  derive  a 
Lyapunov  function  for  the  linear  time- var ying  ,  cascaded 
system  for  both  the  continuous- time  and  discrete-time 
problems.  The  third  objective  is  to  apply  Lyapunov 
theory  to  the  problem  of  system  stability,  given  varia¬ 
tions  in  the  parameters  of  the  system  dynamics  and  meas¬ 
urement  device.  The  first  step  is  to  use  the  Lyapunov 
function  derived  for  the  cascaded  system.  A  Lyapunov 
function  is  then  derived  where  these  parameter  modelling 
errors  are  emphasized  in  the  models.  The  fourth  objec¬ 
tive  is  to  apply  these  Lyapunov  functions  to  specific 
examples.  Two  of  the  examples  involve  parameter  varia¬ 
tion  analysis  for  linear,  time- invar iant  problems,  where 
eigenvalue  analysis  results  are  available.  This  is  to 
determine  the  validity  of  these  Lyapunov  functions.  A 
third  example  is  a  linear,  time-varying  guidance  prob¬ 
lem.  As  previously  stated,  the  time-varying  problem 
considered  is  a  finite  time  problem.  The  Lyapunov  func¬ 
tions  is  used  to  provide  a  measure  of  performance  of  the 
system.  Although  the  dynamics,  controller,  and  observer 
are  linear,  the  fact  that  the  coefficient  matrix  in  the 
pseudo-linear  measurement  is  a  function  of  the  nonlinear 
measurements  of  the  states  makes  the  whole  loop  non- 
1  inear  . 


1.1.3  Homing  Missile  Problem  with  Angle  Only  Measur e- 
ments 


Application  of  optimal  control  theory  and 
optimal  estimation  theory  to  the  homing  missile  guidance 
problem  have  drawn  much  attention  in  recent  years  [131]. 
The  most  commonly  used  control  theory  is  linear  qua¬ 
dratic  Gaussian  {LQG)  theory  because  it  is  based  on  a 
linear  system  model  and  provides  a  closed  form  solution. 

One  of  the  fundamental  problems  that  has  limited 
the  practicality  of  the  LQG  control  law  is  the  diffi¬ 
culty  in  obtaining  the  accurate  state  information 
required.  The  LQG  guidance  law  is  a  function  of 
missile- to-target  position,  velocity,  and  target 
acceleration.  Most  present  day  missiles  can  obtain  a 
measure  of  the  missile's  acceleration  through  on-board 
accelerometers.  In  addition,  passive  seekers  are  used 
to  provide  a  measure  of  1 ine-of-sig ht  angle  and  rate. 
It  is  obvious  that  the  information  required  by  the  con¬ 
trol  law  is  not  directly  available  and,  therefore,  must 
be  estimated. 

The  estimation  algorithm  used  for  this  effort  is 
a  psuedomeasur ement  observer  (PMO) .  This  involves  tak¬ 
ing  the  nonlinear  angle  measurement  model  and  transform¬ 


ing  it  to  a  new  measurement  model  which  is  linear  in  the 


1 


states  of  the  system  [103].  This  algorithm  is  presented 
in  detail  in  Section  V. 


One  of  the  most  difficult  and  critical  problems 
in  the  observer  design  is  how  to  model  the  target 
acceleration.  The  target  acceleration  cannot  be  meas¬ 
ured  directly,  and  directly  effects  the  rest  of  the 
states.  Therefore,  variations  in  the  target  accelera¬ 
tion  model  parameters  will  be  investigated. 


1.2  Missile  Observer  Performance  Improvements  Through 
Optimal  Feedback  Control 


Most  guidance  and  estimation  schemes  are  derived 
separately  and  are  combined  through  the  separation  prin¬ 
ciple.  The  guidance  law  which  has  received  considerable 
attention  is  the  one  derived  from  linear  quadratic  Gaus¬ 
sian  ;LQG)  theory.  It  is  a  useful  tneory  because  it 
provides  a  linear,  closed-form  solution;  and  at  the  same 
time,  has  demonstrated  the  potential  for  significant 


missile  guidance  improvements  [109].  The  guidance  law 
is  designed  under  the  assumption  that  the  missile-to- 
target  position,  velocity,  acceleration,  and  time-to-go 
are  available  and  known  accurately.  With  the  exception 
of  the  missile's  acceleration,  this  information  is  not 
available  on  board  a  homing  missile.  To  provide  the  LQG 
guidance  law  with  an  estimate  of  tnese  values, 
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estimation  algorithms  developed  from  Kalman  filter 
theory  have  been  extensively  investigated  [63,  109]. 


For  missile  systems  with  passive  (angle-only) 
seekers  on  board,  the  estimation  algorithms  have  not 
been  very  successful  in  accurately  estimating  the  state 
information  [131];  however,  the  guidance  laws  have  still 
been  successful  in  producing  small  terminal  miss  dis¬ 
tances.  The  guidance  law  could  produce  even  smaller 
terminal  miss  if  the  state  information  were  more  accu¬ 
rately  known. 


The  intent  of  this  part  of  the  research  is  to 
design  a  LOG  guidance  law  that  not  only  tries  to  minim¬ 
ize  the  final  miss  distance  (which  it  does  now)  ,  but 
also  to  improve  the  performance  of  the  estimation  algo¬ 
rithm.  Improving  tne  estimators  performance  is  done  by 
incorporating  a  term  in  the  performance  index  which 
attempts  to  maximize  the  observability  Grammian  matrix 
of  the  estimation  algorithm. 


This  approach  is  similiar  to  the  efforts  of 
Hull,  Speyer,  Tseng,  and  Larson  [63],  in  which  they 
developed  a  guidance  law  using  the  LQG  performance  index 
which  included  a  term  that  would  maximize  the  informa¬ 
tion  matrix.  The  guidance  law  could  not  be  solved  in 
closed  form,  requiring  the  use  of  a  numerical  optimiza¬ 
tion  program.  The  results,  however,  did  show  that  the 


guidance  law  could  improve  the  filter  algorithm's  per¬ 
formance  while  attempting  to  hit  the  target. 


The  observability  term  in  the  performance  index 
for  this  effort  is  based  on  the  Lyapunov  functions 
derived  for  the  linear,  time-varying  problem.  The 
results  of  this  effort  differ  from  Hull,  Speyer,  Tseng, 
and  Larson  in  that  a  closed  form  solution  is  attainable. 


1 . 3  Synopsis 


In  Section  II,  the  two  Lyapunov  stability 
methods  are  presented  in  detail.  Next,  the  Lyapunov 
functions  for  the  separate  linear  time-varying  con¬ 
troller  and  observer  (estimation  algorithm)  are  dis¬ 
cussed.  T.nese  two  separate  Lyapunov  functions  are  then 
combined  to  determine  if  they  represent  a  valid  Lyapunov 
function  for  tne  cascaded  system.  This  is  done  for  noth 
the  continuous- time  case  and  the  d iscr ete- time  case. 
The  discrete-time  case  is  addressed  since  the  majority 
of  future  guidance  and  estimation  algorithms  will  exist 
on  digital  computers. 


In  Section  III,  a  Lyapunov  function  is  derived 
for  tne  cascaded  system,  assuming  the  control  law  is  a 


linear  function  of  tne  estimated  states 


Tr.is  is  accom¬ 


plished  by  setting  the  Lyapunov  function  equal  to  the 
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average  value  of  the  performance  index.  The  Lyapunov 
function  will  be  validated  through  the  Lyapunov  stabil¬ 
ity  conditions  stated  in  Section  II.  Again,  this  is 
done  for  both  the  continuous- time  and  discrete-time 
problem . 


In  Section  IV,  a  Lyapunov  function  is  derived 
for  the  cascaded  system,  taking  into  account  parameter 
variations.  The  first  step  is  to  identify  these  parame¬ 
ter  uncertainties,  and  to  incorporate  them  into  the 
linear,  time-varying  system  model.  The  derivation  is 
the  same  as  in  Section  III,  which  is  done  by  equating 
the  Lyapunov  function  to  the  optimal  return  function. 
Tne  validation  process  is  also  the  same  as  in  Section 


In  Section  V,  the  LQG  guidance  law  is  derived  to 
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algorithm  performance.  The  estimation  algorithm  used  is 
the  pseudomeasurement  observer. 


In  Section  VI,  several  applications  of  these 
Lyapunov  functions  are  studied  by  numerical  analysis  and 
simulations.  Given  two  linear,  time-invariant  examples, 
the  three  Lyapunov  functions  are  used  to  determine 


acceptable  ranges  of  parameter  uncertainties  in  order  to 
maintain  system  stability.  Variations  in  tne  control 


matrix  are  considered.  The  results  are  compared  to  an 


eigenvalue  analysis  of  the  same  system  with  Darameter 
variations  to  determine  the  accuracy  of  the  Lyapunov 
functions  to  predict  the  boundaries  of  stability.  The 
first  example  is  the  scalar  cascaded  system  by  Speyer 
[122]  and  the  second  example  is  a  multivariable  cascaded 
system  of  Doyle  and  Stein  [41]. 

The  next  step  is  to  demonstrate  the  effective¬ 
ness  of  the  Lyapunov  function  for  a  linear,  time-varying 
system.  The  first  example  is  a  linear  quadratic  Gaus¬ 
sian  guidance  problem,  where  the  control  law  is  time 
varying  (a  function  of  time-to-go).  The  Lyapunov  func¬ 
tions  are  used  to  analyze  system  performance  given 
errors  in  time-to-go  and  errors  in  the  modelled  system 
dynamic  matrix.  In  the  second  example, a  homing  missile 
guidance  system  is  formed  using  a  pseudomeasurement 
observer,  with  angle-only  measurements,  to  estimate  the 
states  for  the  control  law.  Tne  Lyapunov  functions  are 
used  to  analyze  system  performance  due  to  errors  in  tar¬ 
get  acceleration  modelling. 

Finally,  the  usefulness  of  the  LQG  guidance  law 
derived  to  minimize  miss  distance  as  well  as  maximize 
the  observability  Grammian  matrix  of  the  pseudomeasure¬ 
ment  observer  is  demonstrated.  Tne  results  are  compared 


to  a  similar  effort 


by  Hull,  Speyer,  Tseng,  and  Larson 


In  Section  VII,  some  of  the  important  results 
are  summarized  and  conclusions  are  drawn  from  these 
results.  Finally,  suggestion  for  future  research  are 
discussed  . 

1.4  Summary  of  Resul ts 

The  analytic  derivations  of  the  Lyapunov  func¬ 
tions  in  this  dissertation  are  based  on  a  cascaded 
contr ol ler/f i 1  ter  system.  The  numerical  results  are 

generated  based  on  the  assumption  that  the  measurements 
were  noiseless,  and  the  filter  works  as  a  observer. 

The  Lyapunov  function  which  consists  of  adding 
the  controller  Lyapunov  function  oy  Anderson  and  Moore 
[5]  to  the  observer  Lyapunov  function  by  Song  and  Speyer 
[119,12!!!  is  not  valid  for  all  contr  ol  1  er /observ  er  sys¬ 
tems.  Lowe vc r,  one  controller  performance  index  is 

scaled  such  that  the  combined  Lyapunov  functions  are 

valid  without  affecting  the  control  gain.  Further,  this 
Lyapunov  function  is  used  as  a  means  of  improving  the 

stability  of  the  contr ol ler /observer  system  through  an 
overall  design  selection  of  the  controller  and  observer 
design  parameters. 

Since  the  combined  Lyapunov  function  is  not 
valid  for  ail  control ler /observer  systems,  a  Lvaounov 


function  is  derived  for  this  system.  The  result  is  a 
Lyapunov  function  which  consists  of  the  separate  con¬ 
troller  and  observer  Lyapunov  functions  and  an  addi¬ 
tional  term  which  is  a  coupling  of  the  system  states  and 
the  observer  errors.  This  Lyapunov  function  is  valid 
for  all  controller /observer  systems.  However,  this 
Lyapunov  function  is  very  sensitive  to  system  parameter 
var iations . 


A  Lyapunov  function  is  derived  to  directly 
account  for  system  parameter  variations.  This  Lyapunov 
function  is  very  accurate  in  identifying  system  stabil¬ 
ity  of  the  linear,  cime-invar iant  system  under  parameter 
variations  when  compared  to  eigenvalue  analysis.  This 
Lyapunov  function  is  also  useful  in  providing  a  measure 
of  system  performance  for  the  linear,  time-varying, 
finite-time  problem  and  the  homing  missile  guidance 
or  oo 1 em . 


Tne  cont.  ol  law  which  is  designed  for  the  mis¬ 
sile  guidance  problem  to  minimize  terminal  miss  as  well 
as  improve  the  performance  of  an  observer  in  the  loop 
causes  the  missile  to  maneuver  in  such  a  way  as  to 
increase  the  observability  Gr ammian  matrix  of  the 
ooserver  and  still  hit  the  target.  Tne  results  are  very 
close  to  those  by  Hull,  Speyer,  Tseng,  and  Larson  '53]. 
Tne  Lyapunov  function  from  Section  III,  whicn  is  used  as 


the  basis  for  the  derivation  of  this  guidance  law,  shows 
an  improvement  in  performance  over  the  linear  quadratic 
Gaussian  guidance  law.  The  main  contribution  is  that  a 
closed-loop  solution  of  the  control  law  is  obtained. 


SECTION  II 


LYAPUNOV  FUNCTION  FROM  SEPARATE  CONTROLLER 
AND  FILTER  LYAPUNOV  FUNCTIONS 


2.1  Introduction 


Lyapunov  functions  have  been  used  for  the  linear 
quadratic  Gaussian  control  feedback  problems,  as  well  as 
Linear  observer  problems  in  order  to  determine  their 
convergence  properties.  For  the  controller,  it  is  as¬ 
sumed  that  all  of  the  system  states  are  available, 
without  inaccuracies.  To  satisfy  the  Lyapunov  criteria 
for  stability,  the  Lyapunov  function  for  the  controller 
is  selected  as  a  quadratic  function  of  the  true  states 
and  tne  controller  Riccati  matrix  [5].  Tne  Lyapunov 
function  for  th°  filter  is  selected  as  a  quadratic  func¬ 
tion  of  the  state  estimation  errors  and  the  inverse  of 
the  filter  covariance  [121].  This  Lyapunov  function  is 
3 1  so  valid  for  the  observer  problem. 

In  a  more  realistic  engagement  environment,  the 
true  states  will  not  be  available  for  the  control  law. 
An  observer  will  be  needed  (for  the  deterministic  case) 
to  provide  estimates  of  the  system  states  to  the  con¬ 
troller.  This  results  in  a  cascaded  filter  and  con- 


troller  in  the  feedback  loop.  This  section  considers 
the  combination  of  the  separate  controller  and  filter 
Lyapunov  functions  for  the  cascaded,  closed-loop  system. 

First,  the  basic  Lyapunov  stability  methods  will 
be  discussed.  Next,  the  Lyapunov  functions  for  the 
separate  controller  and  filter  will  be  presented,  along 
with  how  they  satisfy  the  Lyapunov  stability  theory. 
These  two  separate  Lyapunov  functions  will  be  combined 
to  determine  if  they  represent  a  valid  Lyapunov  function 
for  the  cascaded  system.  This  is  done  for  both  the 
continuous- time  case  and  the  discrete-time  case. 

2 . 2  Lyapunov  Stability 

Lyapunov  stability  (unlike  eigenvalue  analysis) 
provides  a  tool  for  analyzing  the  convergence  properties 
of  linear  time-varying  systems,  nonlinear  systems,  and 
stochastic  systems  [95,139].  This  dissertation  is  lim¬ 
ited  to  deterministic  systems  only.  Stability  in  the 
sense  of  Lyapunov  can  be  stated  as  follows: 

Consider  the  following  deterministic  system  dif¬ 
ferential  equation 


x  ( t)  =  f  (  x  ( t)  ,  t) 


x(t 


=  X , 


(2 
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where  x(t)  is  the  solution  to  equation  (2.1)  and  is  an 

n-d imensional  state  vector,  t  is  time,  and  f  is  a 

bounded  function  over  the  time  interval.  Consider  a 

nominal  solution,  x^(t),  to  equation  (2.1).  The  nominal 

solution  is  stable  in  the  sense  of  Lyapunov  [18,54,95] 

if  to  each  <>0  (no  matter  how  small),  and  given  t  , 

0 

there  corresponds  a  6{«,t  )  such  that 


d[x{to’  -  xn(to)]  <  6 


(2.2) 


implies  that 


d  [  x  ( t)  -  *n(t)  ]  <  < 


(2.3) 


for  all  t  >  t  where  d[»]  is  a  distance  measure  (Fiqure 

Of 

2.1).  This  is  known  as  Lyapunov's  first  method,  and 
requires  an  explicit  solution  to  the  differential  equa¬ 
tion  (2.1). 

A.  more  useful  technique  which  does  not  require 
the  solution  to  the  differential  equation  is  Lyapunov's 
second  method.  This  is  accomplished  through  the  selec¬ 
tion  of  a  generalized  scalar  potential  function,  called 
a  Lyapunov  function,  V(x(t)  ,t)  .  The  sufficient  condi¬ 
tions  for  stability  in  the  sense  of  Lyapunov  over  the 
state  space  are  as  follows  [18,95]: 


i)  V(0,t)  =  e 
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Figure  2.1,  Lyapunov  Stability 


ii)  V(x,t)  is  continuous  in  both  x  and  t  for 
all  x  <  Rn ,  and  the  first  partial  derivatives  in  these 
variables  exist. 


iii)  There  exist  continuous  nondecr easing  scalar 


v  ax ued 


f unctions  , 


d  and  3 , 


p  ( I  |  x  !  I )  >V  { x  ,  t )  _>c(  (I  I  x  I  I )  >  0  for  I  I x!  1^0. 


iv)  V  (x,t)  <  W(x)  <  0  for  some  continuous, 


nonpositive  W(«) ,  where 


(2.4) 


where  x^  denotes  tne  components  of  the  vector  x.  If  in 
addition,  W(  •)  is  continuous  3nd  negative  definite  or 
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V(x,t)/0  except  at  x  =  0,  the  solution  is  asymptotically 
stable  [5,38].  The  nominal  solution,  xn(t)  is  said  to 
be  asymptotically  stable  in  the  sense  of  Lyapunov  if 
every  motion  starting  sufficiently  near  x(t)  converges 
to  x ( t)  as  t->oo . 

Lyapunov  functions  are  by  no  means  unique,  and 
some  functions  can  provide  more  meaningful  stability 
results  than  others  [95].  For  nonlinear  systems,  the 
selection  of  a  useful  Lyapunov  function  is  often  diffi¬ 


cult. 


For  the  case  where  f(x(t) ,t)  is  linear  and 


time- invar iant ,  equation  (2.1)  becomes 


x ( t )  =  Fx ( t)  ,  x(to)  =  xo 


(2.5) 


The  stability  of  this  system  can  be  determined  by 
obtaining  the  eigenvalues  of  F  [38,95],  The  system 
model  of  equation  (2.5)  is  staole  in  the  sense  of 
Lyapunov  if  and  only  if  the  eigenvalues  of  F  have  nonpo¬ 
sitive  real  parts  and,  to  any  eigenvalue  on  the  ima¬ 
ginary  axis  with  multiplicity  k,  there  correspond 
exactly  k  eigenvectors  of  F.  The  system  model  is  asymp¬ 
totically  stable  if  the  eigenvalues  nave  strictly  nega¬ 
tive  real  parts. 

Another  means  of  determining  stability  for  the 
t ime- invar iant  model  is  to  choose  a  quadratic  Lyapunov 
function  of  the  form 
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V  ( x  ( t)  )  =  x  ( t)  Kx  ( t) 


(2.6) 


where  K  is  symmetric  and  positive  definite  [38,92,111). 
The  derivative  of  V(x(t))  becomes 


V  (  x  ( t)  )  =  xT  ( t)  Kx  ( t)  +  xT  ( t)  Kx  ( t) 


=  x T ( t )  [FTK  +  KF]  x ( t ) 


=  -  x"  (t)Qx(t) 


(2.7) 


Therefore  , 


Q  +  F  K  +  KF  =  0 


is  called  the  Lyapunov  equation, 


(2.8) 


Choose  Q  to  be  positive  semidefinite  and  solve 
equation  (2.8)  for  K.  If  K  is  positive  definite  then 
this  becomes  a  necessary  and  sufficient  condition  for 
asymptotic  stability  of  the  system  in  equation  (2.5) 


[93]  . 


becomes 


For  linear,  time-varying  systems,  equation  (2.1) 


x  ( t)  =  F  ( t)  x  ( t)  ,  x  ( tQ)  =  x0 


(2.9) 


Eigenvalue  analysis  may  not  pro vide  useful  information; 
however,  Lyapunov's  second  method  does  apply.  Again, 
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choose  the  Lyapunov  function  as  the  following  quadratic 
form 


V  {  x  ( t)  ,t)  =  x  ( t)  K  ( t)  x  ( t) 


(2.10) 


where  K(t)  is  still  symmetric  and  positive  definite,  and 
is  determined  by  the  following  differential  Lyapunov 
equation 


K(t)  =  -K  ( t )  F  ( t )  -  F  ( t)  XK  ( t)  -  Q  ( t)  ,  K(tf)  =  Kf  (2.11) 

where  Q(t)>_0.  For  K(t)  bounded  and  positive  definite, 
and  V  ( x  ( t)  ,t)  <0  for  x  ^0,  the  system  in  equation  (2.9) 
is  asymptotically  stable  [96], 

If  it  is  desired  to  analyze  the  zero-input  sta¬ 
bility  of  a  nonlinear  system  model  through  the  linear 
techniques  just  described,  the  nonlinear  system  model 
would  have  to  be  linearized  about  some  operating  point 
(xn(t))  via  a  Taylor  series  expansion,  where  all  non¬ 
linear  terms  are  ignored  [95,113].  The  linearized  ver¬ 
sion  of  equation  (2.1)  is 


6x(t)  = 


*» 

bf  (x  ,  t) 
bx 

X  =  X  (t) 

- 

n 

6x  ( t) 


(2.12) 


wnere  6x(t)  =  x(t)  -  xn(t)  (a  perturbation). 

The  linear  stability  techniques  can  be  applied 


y 


ion  problem 


+  )0(X  (t)Qc(t)x(t)  +  u  (t)R(t)u(t))dt  (2.13) 
subject  to 

x(t)  =  A  ( t)  x  { t)  +  B  ( t)  u  ( t)  ,  x(tQ)  =  xQ  (2.14) 

where  is  the  value  of  x  at  the  final  time. 

GF-0  '  0'  R(t)>0,  and  A(t)  and  B(t)  are  linear 

time-varying  matrices.  The  optimal  control,  u(t),  is  a 
linear  function  of  the  states  as  follows  'll) 

u  ( t )  =  -  L  ( t)  x  ( t)  ,  t«  ( (2.15) 

t  -- 

where 

L  ( t )  =  R"1  (t)BT(t)?(t)  (2.16) 

and 

P(t)=  -P  { t)  A  ( t)  -  AT  ( t )  P  ( t ) 

+  LT  (t)  R(f  L  (t)  - 


Oft) 


(2.17) 


which  is  the  control  Rice  a  t i  matrix.  Equation  (2.17) 
can  be  rewritten  as 

P(t)  =  -  P(t)Mt)  -  AT(t)P(t) 

-  LT (t) R (t) L (t)  -  Qc (t)  (2.19) 

where 

Eft)  =  Aft)  -  3(t)  L(t)  (2.20) 

The  Lyapunov  function  that  is  typically  used  for  this 
control  problem  is 

v  ( x  ,  t )  =  xT (t) P (t) x  ( t )  (2.21) 

where  ?(t)  comes  from  equation  (2.19).  If  (A(t),B(t)) 
is  controllable  and  'Vt',Ql  ^'t-'  is  observable 
[25,34],  tnen  ?(t)  is  bounded  and  positive  definite. 
Tnis  satisfies  the  sufficiency  conditions  for  asymptotic 
stability  in  the  sense  of  Lyapunov  [121].  Therefore, 
equation  (2.21)  represents  a  good  Lyapunov  function  for 
the  control  problem. 

Equation  (2.21)  can  be  derived  by  defining  the 
Lyapunov  function  to  be  ecu. valent  to  the  optimal  return 

function,  J  ,  wh01"  e 

o  ’ 


v  ( x  ,  t ) 


min  { 
u  (  t) 


2.3.2 

solved 


sub j  ec 

where 

still 

where 

and 


Discrete-Time  Lyapunov  Function 

The  linear  quadratic  optimization  problem  can  be 
for  the  discrete-time  problem  as  follows: 

N-l 

J  =  XNGNxN  +  5  XKQc..xK  +  UKRKUK  (2.23) 

K  =  U  r\ 

t  to 


XK+1  =  AkxK  +  BKuK  (2.24) 

,  Q_  >0,  Rk>0,  and  the  ootimal  control  is 
“K  * 

a  linear  function  of  the  states  and  becomes  [79] 

uK  =  -  Lkxr  ,K  =  0, . . . , N  (2.25) 


LK  - 


(RK  +  BKPK+1BK}  3KPK+lAk 


(2.26) 


— T  — 

=  L  1  V  z.  + 

K  ~  K-t-1  K 


T 

-  d  r 
J  K  K  “  K 


(2.2' 


Ak  =  Ak  -  BkLk 


(2.28) 


3y  equating  the  discrete  Lyapunov  function  to  the 
discrete  optimal  return  function 


=  J  =  min  {J} 
UK 


(2.29) 


the  Lyapunov  function  becomes 


V  -  V  1 P  V 

k  XK  KXK 


(2.30) 


where  P  is  symmetric,  positive  definite  by  assuming 


( A  k , B  k )  is  controllable  and  (A K,Q^'Z)  is  observable 

K 


[25,84],  This  satisfies  the  first  three  conditions  for 
a  Lyapunov  function.  For  the  d iscrete-time  problem,  the 
fourth  condition  is  replaced  by 


^VK  =  Vl  -  ”K  1  0 


(2.31) 
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Avk  - 


-xK(LXLK  +  2C„|XK 

K 


(2.32) 


With  positive  semidefinite  and  R,,  positive  definite, 
""K  K  ‘ 

the  fourth  condition  is  satisfied;  therefore,  equation 
(2.3C)  is  a  good  Lyapunov  function  for  the  linear 
d iscrete-time  control  problem. 


2 . 4  Linear  Filter 


2.4.1  Continuous ,  Time-Var y ing  Lyapunov  Function 


Consider  the  following  model  of  a  linear  time- 
varying  filter  [48] 


x(t)  =  A  ( t)  x(t) 


+  K  ( t)  [ y ( t)  -  H  ( t ) x ( t ) ]  ,  x(tQ)  =  xQ  (2.33) 


where  the  dynamic  system  is 


x(t)  =  A  ( t )  x  ( t )  +  3  ( t )  u  ( t )  +  r(t)ui(t) 


(2.34) 


(2.35) 


(2.36) 


oj(t)  _  N  (0  ,Q0  ( t)  6  ( t-f)  ) 


v  ( t )  =  H  ( t )  x  ( t )  +  (/( t ) 


(/(t)  _  n  (0  ,ro  ( t)  6  (t-r) ) 


K  (t)  =  P  (t)  HT  { t )  R”1  (t) 


P  =  A  (t)  P  (t)  +  P  (t)  A1  (t) 


K  (t)Ro(t)KT(t)  +  Q0(t' 


P  (  t  ,  !  =  D  , 


(2.37) 
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where  x(t)  is  the  state  estimate,  y(t)  is  the  measure¬ 
ment,  A  { t )  is  the  state  dynamics  matrix,  H(t)  is  the 
measurement  matrix,  K(t)  is  the  Kalman  gain,  P(t)  is  the 
error  covariance,  and  (/(t)  and  m(t)  are  Gaussian  white 
noise  models  where  R  (t)  and  Q  (t)  are  the  measurement 
and  state  power  spectral  densities,  respectively  [48]. 
The  estimation  error  is  given  by  the  equation 


e  ( t)  =  x  ( t)  -  x  ( t) 


(2.39) 


Differentiating  this  equation,  using  equation  (2.33)  and 
(2.34),  provides  the  following  linear  dynamic  equation 
for  the  estimation  error 


e(t)  =  (Aft)  -  K(t)H(t))e(t)  -  K(t)(/(t)  +  P(t)ui(t) 


/  o  n  ' 

I  4  •  J 


Define  the  cost  functional  as 


t 

J  *  $  a  ei(t)QQ(t)e(t)dt 


(2.41) 


subject  to  equation  (2.40),  where  Q0(t)  is  the  weighting 
on  the  state  error  and  will  be  defined  later.  By  using 
equation  (2.22),  the  Lyapunov  function  for  the  linear, 
time-varvina  filter  oroblem  becomes 


V (e ,t) 


e  (t)  P (t) e(t) 


(2.42) 


where 

P(t)  =  -F(t)  A  (t)  -  A T  ( t )  P  ( t )  -  Qe(t)  (2.43) 

F(tf)  =  Pf  (2.44) 

where 

A  (t)  =  A ( t )  -  K (t) H  (t)  (2.45) 

If  Qe(t)  is  chosen  as 

2e(t)  =  P-1  (t)Qo  (t)  p'1  (t)  +  HT  (t)  R^1  (t)  H  (t)  (2.46) 

then  the  following  identity  can  be  made 

?(t)  «  P'1  (t)  (2.47) 

which  can  oe  shown  by  inverting  equation  (2.37).  There¬ 
fore,  the  Lyapunov  function  for  the  observer  becomes 

V  ( e  ,  t )  =  eT(t)  P’1  (t)  e  (t)  (2.48) 

which  is  what  is  most  commonly  used.  Assuming 
( A ( t )  ,  H  { t )  )  is  observable  and  ( A ( t)  ,r  ( t ) )  is  controll¬ 
able  (25,84],  tnen  P(t)  is  bounded  and  positive  definite 


and  equation  (2.48)  satisfies  all  four  requirements  of 
Section  2.2  to  be  a  valid  Lyapunov  function  for  the 


linear,  time-varying  filter  described  in  equations 
(2. 33)- (2. 38)  . 

The  filter  algorithm  (equations  2.33  to  2.38) 
can  be  converted  to  an  observer  by  changing  equation 
(2.35)  to 


y  ( t)  =  H  ( t ) X ( t )  (2.49) 

The  Lyapunov  function  (equation  2.48)  remains  the  same 
for  the  observer  problem. 

2.4.2  Discrete-Time  Lyapunov  Function 

?ne  algorithms  for  the  linear,  discrete-time  filter  are 


XK-1  AKXK  +  3KUK  +  KK+1  ‘YK~HK  +  1XK  +  1]  (2.50) 


XKJ-1  =  AKXK  +  BKUK  +  ^  ~  N(0'QO  )  (2.51) 

K 


VK  =  Hkxk  +  C7r  ,  (/R  -  N(0,Ro  )  (2.52) 

K 


XK  =  AK-1XK-1  +  3KUK 


(2.53) 


KK  =  PKKKtHKPKHK  +  rk5 


(2.54) 


AV 


**  u*  u  n  trw  hr*  wn  mkm*.  u*v  ir"M^MF j/  "jnji  AJT^jrrjr AJ^jrrjrnjrnjrTS^^r^jrrj^^ 


p’k  ■  <i-kkhkIpk<i-kkhk'T  +  VoA 

ss 


(2.55) 


PK  =  AK-1PK-1AK-1  +  Qo, 


(2.56) 


where  xR  is  the  true  state,  xR  is  the  state  estimate,  y{ 
is  the  measurement,  A„  is  the  state  dynamics  matrix,  Bt 


K«yC-» 


is  the  controller  matrix,  uR  is  the  control  law,  kr  is 

the  Kalman  gain,  PK  is  the  covariance  matrix,  and 

(/j,  and  LUj,  are  Gaussian  white  noise  models  where 

R-  and  Q_  are  measurement  and  state  Dower  soectral 
°K  °K 

densities,  respectively.  By  defining  the  cost  func¬ 
tional  as 


J  “  2  e  Qo  eK 

K=0  N  ~K  N 


(2.57) 


and  using  equation  (2.29),  the  discrete-time  Lyapunov 
function  becomes 


V  s  eTP-1e 
K  eK  K  K 


(2.58) 


where 


P  K-l  "  AKPKIak  +  Qe, 


ak  =  (I  -  KKHK>AK-1 


(2.59) 


(2.60) 


-  wu  w  WV  WW  AWWW  iTJWif- V.'W  r-M*J rWtrVTOl VJV* niTWTWWTjr^r 


O  -  p  ~  i  a  ~  -^  (  V  ^  +  A  TP_1A  2)  1A'TP"1 

Qe  -  PK  ak  (KK  AK  K  AK  '  AK  PK 

K 


/r  (I-KKHK)Qo  (I-KKHK) 
K 


(2.61) 


(2.62; 


+  kkrokkk 


where  Q  is  positive  definite  (Appendix  A) 
K 


The  Lyapunov  function  of  equation  (2.58)  satis¬ 
fies  all  four  requirements  of  Section  2.2  and  is  there¬ 
fore  valid. 


As  in  Section  2.4.1,  the  discrete-time  filter 
algorithm  (equations  2.50  to  2.56)  can  be  converted  to  a 
d iscrete- time  observer  algorithm  by  ignoring  the  noise 
term  in  equation  (2.52) ,  such  that  the  discrete  measure¬ 
ment  becomes 


yK  =  HKXK 


(2.63) 


The  Lyapunov  function  (equation  2.58)  remains  the  same 
for  the  discrete  observer  problem. 
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2 . 5  Combining  Controller  &  Filter  Lyapunov  Functions  for 
Cascaded  Systems 


2.5.1  Continuous,  Time-Varying  Combined  Lyapunov  Func- 


By  including  the  filter  in  the  feedback  loop, 
and  by  incorporating  the  state  estimates  in  the  control 
law  in  the  following  way 


u  (t)  =  -L  (t)  x  (t) 


the  closed-loop  system  dynamics  become 


(2.64) 


x(t)  =  2T(t)  x  ( t )  +  B(t)L(t)e(t) 


e(t)  =  A  ( t)  e  ( t) 


(2.65) 


(2.66) 


Prooosition  2.1 


V(x,e,t)  satisfies  the  sufficiency  conditions 
for  asymptotic  stability  in  the  sense  of  Lyapunov  for 
the  continuous,  time-varying  system  described  in  equa¬ 
tions  ( 2 . 64 ) - ( 2 . 66 )  where 


V(x,e,t)  = 


[xT  (t)  eT(t)l  0 


P"1  (t) 


(2.67) 


under  tne  assumptions  that  (A(t),B(t>)  and  ( A  ( t)  ,"*  ( t)  ) 
are  controllable,  and  ( A ( t)  , Qj/2 ( t)  )  and  (A(t),H(t))  are 


V 


observable.  The  control  gain,  L(t)  ,  and  the  Kalman 
gain,  K(t),  are  chosen  as  the  optimal  values  (equations 
2.16  and  2.36).  Equation  (2.67)  comes  from  equations 


(2.21)  and  (2.48)  . 

Proof  : 


3y 

assuming  (A(t),B(t))  and  (A(t),P(t))  are 

con- 

trollable , 

and 

( A  ( t )  ,  Q^/2(t)) 

and  ( A  ( t)  ,  H  ( t)  ) 

are 

observable 

,  P(t) 

and  p“ 1  ( t)  are 

positive  definite 

and 

bounded  . 

Thus  , 

equation  (2.67) 

satisfies  the 

first 

three  Lyapunov  function  requirements  from  Section  2.2. 
To  evaluate  the  fourth  condition,  equation  (2.67)  must 
be  differentiated. 


V  ( x  , e  ,  t )  =  [xT  (t)  eT  ( t )  ] 


P  (t) 
0 


p  1  rt) 


[e(t)] 


+  [  x 1  ( t )  e  T  ( t )  ] 


[  x  T  ( t )  eT(t)] 


P(t) 

0 


P(t) 

0 


0 

•-1 

P  (t) 


P"1  (t) 


(2.68) 


From  equations  '2.19),  (2.43),  (2.65',  and  (2.66),  the 

derivative  of  the  Lyapunov  function  is 


?v 


V  ( x  ,  e  ,  t )  =  [xT(t)  eT  ( t)  ] 


■L  (t)  R(t) L (t)  -Q„ (t) 
LT  (t)  R  (t)  L  (t) 


L 1  (t)  R(t)  L  (t) 

-P_1  (t)QoP-1  (t)  -HT  (t)  R"1  (t)  H  (t) 


[e(t)J 


(2.69) 


V  ( x  ,e  ,  t )  =  [  x T  ( t )  eT(t)  ]  Q  ( t )  (2.70) 

• 

In  order  to  satisfy  the  fourth  requirement  (i.e.  V<_  0 )  , 

it  is  sufficient  that  >j(t)  be  negative  semidef inite . 
However,  it  is  not  analytically  possible  to  show  that 
U(t)  is  negative  semidef inite .  Through  the  selection  of 

F(t)  ,  Qc(t)  ,  R  (t)  ,  and  Q  { t)  ,  it  may  be  possible  to 
show  numerically  that  ”5(t)  is  negative  semidef  inite  . 


A  way  of  ensuring  that  2(t)  is  negative  serr.ide- 
finite  is  to  change  Grf  and  R  by  the  following: 


"f  =  -cf 


gf  ,  Qc 

"cf  '  Qc  '  ~ 


*  cf 


(2.71) 


(2.72) 


such  that  tne  performance  index  (equation  2.13)  becomes 


P  ^  P  rp  V  r'  rr.  rj 

J  =  x^xp  +  r  *  [x T  ^  x  +  u*  |  u]  dt  (2.73) 


For  this  control  problem,  the  control  gain  remains  the 


same  for  all  positive  values  of  c( ,  including  c(  =  1 . 

This  is  so  because  the  new  Riccati  matrix  is  a  scaled 
function  of  the  original  one  (equation  2.17)  (i.e. 

Pnew=c*P)  *  The  contr°l  gain  is  a  multiple  of  Rpnew  which 
equals  RP.  c(  can  be  selected  so  that  Q(t)  is  negative 
semidef inite .  The  controllability  and  observability 
conditions  insure  that  V(x,e,t)^0  except  at  x=0  [96]; 

thus,  the  system  described  in  equations  (2-64)— (2.66)  is 
asymptotically  stable  in  the  sense  of  Lyapunov,  and  the 
function 


V 


[xT  eT] 


(2.74) 


which  consists  of  combining  the  separate  controller  and 
filter  Lyapunov  functions,  could  be  a  good  Lyapunov 
function  oy  properly  selecting  c( ,  without  changing  the 
controller  or  filter  gains. 


2.5.2  Discrete-Time  Combined  Lyapunov  Function 

For  the  contr  oller./f  ilter  cascaded  system,  the  closed- 
loop  system  difference  equations  are 


‘  K  +  l 


=  AKxK 


+  3KLKeK 


(2.75) 


1  —  A  o 

K+l  *K~K 


(2.76) 


ProDOsition  2.2 


VK^xK'eK'tK^  satisfies  the  sufficiency  condi¬ 
tions  for  asymptotic  stability  in  the  sense  of  Lyapunov 
for  the  discrete,  time-varying  system  described  in  equa¬ 
tions  (2  .  75 ) - (2 . 76 }  where 


VK(xK'eK'tK)  =  [XK  6k] 


K  0 


(2.77) 


under  the  assumptions  that  (Ar,bk)  and  (AK,[%)  are  con- 


K '  K' 


troll  able ,  and  (Ar,q^/2)  and  (A^H*)  are  observable. 


K '  K ' 


The  control  gain,  LR ,  and  the  Kalman  gain,  KR ,  are 
chosen  as  the  optimal  values  (equations  2.26  and  2.54). 


Equation  {2.11) 


equations  (2.3C)  an: 


(2.58).  From  the  assumptions  in  Proposition  2.2,  PR  and 

Pj^  are  positive  definite  for  all  K  =  0,1,.. ,,N,  and 
bounded.  Thus,  the  first  three  Lyapunov  function 
requirements  are  satisfied  oy  equation  (2.77).  Dif¬ 
ferencing  VR  and  VK+1 : 


Av  =  Vv.  -  V, 


(2.78) 


I.' m  b'.li’A* 


oI  K  K  K  „K 
K  'K  rTR  L 

lkhklk 


lkrklk  Pk' 


(2.79) 


Avk  =  [xK  eKlQK 


(2.83) 


where  is  defined  in  equation  (2.61).  For  AV„<0,  it 

_K  n- 

is  sufficient  that  QR  be  negative  semidef inite  .  How¬ 
ever,  as  in  the  continuous- time  case,  it  is  not  possible 
to  show  analytically  that  (JR  is  negative  semidef  inite , 

Through  the  selection  of  R„ ,  Q„  ,  R„  ,  and  it  is 

K  _K  °K 

possible  to  show  numerically  that  QR  is  negative  semide- 
finite.  Therefore,  equation  (2.77)  may  not  be  the  best 
choice  for  a  Lyapunov  function  for  the  cascaded  system. 
Tne  next  loo  leal  steo  is  to  attempt  to  derive  a  Lyapunov 
function  for  the  cascaded  system,  with  the  technique  used 
to  derive  tne  separate  controller  and  filter  Lyapunov 
functions.  This  is  accomolished  in  the  next  section. 


SECTION  III 


LYAPUNOV  FUNCTION  DERIVATION  FOR  CASCADED 
CONTROLLER/FILTER  CLOSED-LOOP  SYSTEM 


3.1  Introduction 


In  the  previous  section,  it  is  shown  that  the 
Lyapunov  function  which  consisted  of  the  sum  of  the 
separate  controller  and  filter  Lyapunov  functions  may 
not  be  valid  for  the  cascaded  linear,  time-varying, 
closed-loop  system.  This  is  due  to  the  fact  that  the 
separate  Lyapunov  functions  are  derived  assuming  the 
control  law  is  a  linear  function  of  the  true  states; 
yet,  the  actual  control  law  is  a  function  of  the  es¬ 
timated  states  from  the  filter. 


Lyapunov  function  for  the  cascaded  system,  assuming  the 
control  law  is  a  linear  function  of  estimated  states. 
This  is  accomplished  by  setting  the  Lyapunov  function 
equal  to  a  conditional  form  of  the  optimal  return  func¬ 
tion  associated  with  the  linear-quadratic  Gaussian  prob¬ 
lem.  It  is  snown  tnat  this  Lyapunov  function  contains 
the  separate  controller  Lyapunov  function,  the  filter 
Lvapunov  function,  and  an  additional  cuadratic  term 


wo 
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which  reflects  the  error  in  the  control  law  due  to  the 
inaccuracy  of  the  state  estimate  from  the  filter.  The 
Lyapunov  function  is  derived  for  both  the  continuous¬ 
time  and  d isc r ete- time  problem. 

3.2  Continuous ,  Linear  ,  Time-Varying  Systems 

3.2.1  Lyapunov  Function  Derivation 

A  Lyapunov  function  is  derived  for  the  continu¬ 
ous,  linear,  time-varying  closed-loop  system  by  equating 
it  to  a  conditional  form  of  the  optimal  return  function. 
Here,  the  unconditional  cost  function  is 


J  =  min  E { J }  (3.1) 
0  u,K 

wnere  £{•';  is  tne  expectation  operator,  u  is  tne  optimal 
control  ,  and  K  in  the  Kalman  gain.  The  performance 
index  is  chosen  as 


J  =  *fGfxf  +  j  *  (xT(t)Qc(t)  x(t) 

+  eA(t)Qo(t)e(t)  +  u1  (t)  R(t)  u(t)  )  dt  (3.2) 


sutiect  to 


X(t) 


[A(t)-B(t)L(t)  ]x(t)+B(t)L(t)e(t)+r  (t)uj(t)  (3.3) 


e(t)  =  [A(t)-K  (t)  H  ( u)  }e(t)-K  (t)  (/( t)  +T  (t)ui(t)  (3.4) 

where 

ui(t)  _  N  (0  ,  Q  ( t)  6  ( t-tr)  )  ,  (/(t)  _  N  (0  ,  R  ( t)  6  ( t-tr)  )  (3.5) 

u(t)  =  -L  ( t)  [  x  ( t)  -  e  ( t)  3  (3.6) 

G-,  Q  _  ( t )  ,  Q  (t)  ,  and  Q(t)  are  symmetric  positive  sem- 
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idefinite,  and  R(t)  and  R(t)  are  symmetric  positive 
definite  . 

It  must  be  noted  that  the  Lyapunov  functions  are 

derived  using  the  noise  properties  of  the  system  states 

and  measurements  as  design  parameters,  rather  chan 

actual  power  spectral  densities.  For  this  reason,  the 
Lyapunov  functions  are  valid  only  for  one  closed-loop 
system  with  an  observer  in  the  loop. 

First,  rewrite  the  performance  index  in  terms  of 
x(t)  and  e(t)  only  and  take  the  expectation. 


index.  To  do  this,  these  equations  have  to  be 
translated  to  dynamic  constraints  in  X(t),  S(t),  and 

P(t).  These  constraints  are  derived  in  Appendix  B  and 
can  be  written  as 
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where 


Aft)  =  Aft)  -  Bft)L(t) 

A  (t)  =  Aft)  -  K  ( t)  H  ( t) 


Using  the  following  definitions 
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-L  (t)R(t)L(t)  L 1  ( t )  R  ( t )  L  ( t )  +Qe(t) 
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=  Q(t) 
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(3.16) 


Q  ( t )  K(t)R(t)K  ( t )  +Q  ( t ) 


the  augmented  performance  index  becomes 


J'  =  tr Gf xf  +  J  0  trQ ( t) X (t) 


+  tr  A(t)  [A  (t)  X  (t)  +  X  (t)  A1  (t)  +  Q  (t)  -  X  (t)  ]  dt  (3. 17) 


where  A(t)  is  the  Lagrange  multiplier  defined  by  the 
following 


Aft'  = 


/^(t)  AsC 
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(3.13) 


The  cost  function  can  be  manipulated  into  the  form  [26] 


J’  =  tr  X  ( t-  )A(  t„ )  +  A  tr  (A(t)Q(t)  )dr  (3.19) 
w  u  T  t0 


=  E  {  [  x T  ( t )  eT(t)  ]A(t)  }  +  tr  (A(t)  Q  (t)  )  dr  (3.20) 


Tne  first  term  in  equation  (3.20)  represents  the  deter¬ 
ministic  part  of  the  problem  3nd  is  an  expected  value  of 
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a  quadratic  term  in  the  states  x  and  e.  Tnis  term  will 
be  called  the  Lyapunov  function  and  is  of  the  form 


rn  m  Av  (  t  )  Ac  (  t  ) 

V(x,e,t)  =  [x7(t)  er  ( t)  ]  *  13 

/^(t)  Ap  ( t) 


’  m 


(3.21 


The  Hamiltonian  of  the  system  is 


H  ( t)  =  tr  Q  { t)  X  ( t) 


+  tr  A(t)  [A  (t)  X  (t)  +  X  ( t)  AT  (t)  +  Q  (t)  ]  (3.22) 


From  the  Eul er-Lagrange  equations, 


A(t)  =  -H.  =  -A(  t)  a  ( t)  -  Mt)A(t) 
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-  Q  (t)  (3.23) 
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(3.25) 
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(3.26) 


From  equation  (3.25) 


Ax(t)  =  -/^(t)A(t)  -  AT(t)/^(t) 


L1  ( t)  R  ( t)  L  ( t)  -  Qc(t)  ,  Ax  ( tf )  =Gf  (3.27) 


Ag(t)  =  -Ag(t)A(t)  -  AT(t)Ag(t) 

-  Aj,  (t)  B(t)  L(t)  +  LT(t)R(t)L(t)  ,  Ag(tf)=0  (3.28) 

Ax(t)  is  equivalent  to  the  controller  Riccati  matrix 
wnich  implies  that  the  control  gain  L(t)  is 


L  (t) 


R 


(t)  B1  (t)/^  (t) 


(3.29) 


For  Ag  (tf )  =  0,  Ag(t)  =  0  for  0  <  t  _<  t£.  Therefore, 

the  Lyapunov  function  reduces  to 

V(x,e,t)  -  (xT(t)  ehtn[^(tl  (3.30) 

where  /^(t)  is  defined  by  equation  (3.27)  and 


ApU)  =  ~Ap(t)A(t)  -  AT(t)/Y(t) 
-  LT(t)R(t)L(t)  -  Qe(t) 

Ap(tf)  =  0 

By  defining 


(3.31) 

(3.32) 


/*>  (')  =  P”1  (t)  +  Pe(t)  (3.33) 

equation  (3.31)  can  be  split  into  two  differential  equa¬ 
tions 


P  (t)  =  -P"1  (t)  A  (t) 


AT  (t)  P_1  (t) 


<-N 


!  t) 


(3.34) 


Pp(t)  «  -Pn(t)A(t)  -  A  ( t)  Pg  ( t) 


-  LT(t)  R(t)  L(t)  ,  P-,(t 


e  v  uf  J 


(3.35) 


The  Lyapunov  function  becomes 


V  (x  ,e  ,t)  =  xT(t)Ax (t) x(t) 


+  eT(t)  P_1  (t)  e(t)  +  eT  ( t)  P  ( t)  e  ( t)  (3.36) 


where  the  first  quadratic  term  is  the  controller 
Lyapunov  function,  the  second  term  is  the  filter 
Lyapunov  function,  and  the  third  term  is  an  additional 
term  that  reflects  the  error  in  the  control  law  due  to 
the  inaccuracy  of  the  state  estimate  from  the  filter. 
As  the  error  increases,  this  term  has  a  stronger  influ¬ 
ence  on  the  Lyapunov  function.  Note  that  ?a(t)  (equa¬ 
tion  3.35)  is  affected  by  both  the  Kalman  gain,  K(t),  in 
A ( t)  ,  and  the  control  law  gain,  L(t).  The  next  step  is 
to  determine  if  equation  (3.30)  is  a  valid  Lyapunov 
function . 
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3.2.2  Lyapunov  Function  Validation 


Pr odos i t ion  3.1 


V  (x  , e  ,  t )  from  equation  (3.30)  satisfies  the  suf¬ 
ficiency  conditions  for  asymptotic  stability  in  the 
sense  of  Lyapunov  for  the  continuous,  time-varying  sys¬ 
tem  described  in  equations  (2 . 64 ) - ( 2 . 66 )  under  the 
assumptions  that  (A(t),B(t))  and  (A(t),r(t))  are  con¬ 
trollable  and  ( A  ( t )  ,  H  ( t )  )  and  ( A  ( t)  ,  Q^; /2  ( t)  )  are  observ¬ 
able  [121].  The  control  gain,  L(t),  and  the  Kalman 
gain,  K(t),  are  chosen  as  their  optimal  values  (equa¬ 
tions  3.29  and  2.36)  . 


Proof : 


By  assuming  (A(t)  ,B(t))  and  (A(t)  ,T(t))  are  con¬ 
trollable  and  ( A  ( t )  ,  H  ( t )  )  and  ( A  ( t)  ,  Q^/2  ( t)  )  )  are 
observable,  A^(t),  which  is  the  control  Riccati  matrix, 

and  P-^(t) ,  which  is  the  observability  Grammian  matrix, 

are  oositive  definite  for  t>t.  and  bounded.  With  P  “'"(t) 


positive  definite  and  Pg(t)  positive  semidefinite  [25], 
^Np  ( t )  is  positive  definite  from  equation  (3.33).  This 
imol ies 


V  ( x  ,  e  ,  t )  >  0 


(3.3“' 


tr  [2  ,  t  c )  and  ail  x(t)  and  e(t)  not  eauai  to  zero. 
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Therefore,  the  first  three  Lyapunov  function  require¬ 
ments  of  Section  2.2  are  satisfied.  The  derivative  of 
equation  (3.30)  is 


V(x,e,t)  =  [xT(t>  eT ( t) ] 


-L  (t)R(t)L(t)-Q  ft) 
★  C 

LT(t)R(t)L(t) 


L  ( t)  R  ( t)  L  ( t) 
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=  [xT(t)  eT  ( t)  ]  Q '  (t)  [e|t)] 


(3.38) 


Rewr iting  Q ' ( t)  as 


Q' (t)  = 


r  t 

«  _  L  (t) 

T 

l~L-  (t)J 


[R  ( t)  ]  [L  ( t)  -L(t)  ] 


-2„  (t) 


-Q_ (t) 


(3.39) 


it  is  obvious  that  for  R(t)>0,  the  first  quadratic 
matrix  in  equation  (3.39)  is  negative  semidef ir.ite  ,  and 
for  Q„(t)>_8  and  Qg(t)>_C,  the  second  matrix  in  equation 
(3.39)  is  negative  semidef inite .  In  addition,  the  con¬ 
trollability  and  observability  conditions  assure  that 
V(x,e,t)=0  only  wnen  x=C.  Tnerefore,  the  derivative  of 
the  Lyapunov  function  becomes 


V  ( x  ,  e  ,  t )  <  3 


(3 . 40) 


for  x^0,  which  satisfies  the  fourth  requirement  for  a 
Lyapunov  function.  The  controllability  and  observabil¬ 
ity  conditions  insure  that  V(x,e,t)^0  except  at  x=0 
[96];  thus,  the  system  described  in  equations  (2.64)- 
(2.65)  is  asymptotically  stable  in  the  sense  of 
Lyapunov.  Therefore,  equation  (3.30)  represents  a  good 
Lyapunov  function  for  the  cascaded,  linear,  time- 
varying,  closed-loop  system.  The  same  Lyapunov  funtion 
(equation  3.30)  is  derived  using  the  Hamil ton-Jacobi 
equation  (Appendix  C)  . 


It  is  important  to  note  that  for  the  linear 
homogeneous  system  (equation  3.3),  the  adjoint  equation 
propogates  the  solution  of  the  original  equation  back¬ 
ward  in  time  [25];  thus,  acting  as  a  predictor  of  the 
system.  With  the  Lyapunov  function  defined  as  a  condi¬ 
tional  form  of  the  optimal  return  function  (equation 
3.30)  ,  the  Lyapunov  matrix,  defined  by  the  backward  Ric- 
cati  differential  equation  (3.25),  has  predictive  quali¬ 
ties  for  the  value  of  the  cost. 


3.2.3  Extension  to  Nonlinear  Svstems 


Based  on  the  results  by  Song  and  Speyer 
[119,120],  this  Lyapunov  function  can  oe  extended  to  the 
class  of  nonlinear  systems  where  the  system  dynamics  are 


l  n  e  a  r  ar.o 


tne  filter  measuremen! 


vocations  are 


nonlinear  functions  of  the  states. 


he  nonlinear  meas¬ 


urements  can  be  transformed  into  a  linear  function  of 
the  states  where  the  coefficient  matrix  is  a  nonlinear 
function  of  the  ooser vations .  The  pseudomeasurement 
observer  (PMO)  and  the  modified  gain  extended  Kalman 
observer  ( MGEKO)  are  based  on  this  concept.  The  algo¬ 
rithm  for  the  PMO  is  presented  in  detail  in  Section 
6.4.1. 


T.ne  Lyapunov  function  (equation  3.36)  is  changed 
by  replacing  Pg(t)  with  the  inverse  of  the  observabil ity 
Grammian  of  the  PMO  (Section  6.4.1).  The  observability 
Grammian  matrix  of  the  PMO  is  positive  definite  for  t>t0 
[103].  The  Lyapunov  functions  derived  in  this  disserta¬ 
tion  3re  valid  for  this  class  of  nonlinear  systems. 

3.3  Discrete-Time  Linear  System 

3.3.1  Lyapunov  Function  Derivation 

A  Lyapunov  function  is  derived  for  tne 
d isc r ete- time ,  linear  closed-loop  system  by  equating  it 
to  a  conditional  form  of  the  optimal  return  function. 
Here,  the  unconditional  cost  function  is 
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Carrying  through  the  expectation,  equation  (3.47) 
becomes 
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To  augment  tne  dynamic  constraint  equations  to 

t.ne  performance  index,  equations  (3.43)  and  (3.44)  have 

to  be  translated  to  difference  equations  in 

<„  S.,  and  PT, .  Tnese  difference  eouetions  are  derived 

t\  ,  t\ ,  K 

in  ho oendix  E.  Tne  result  is 
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(3.58) 


and  is  the  Lagrange  multiplier.  The  cost  function 

can  be  manipulated  into  the  form  [26] 
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where  V  (x,  ,e„/t„)  is  chosen  to  be  a  Lyapunov  function 
K  '  X  K  K 


of  the  form 
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Tne  discrete  Hamiltonian  of  the  system  is 
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(3.61) 


From  the  Eul er -Lag r ang e  equations 
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From  the  difference  eouation  for  A 
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From  equation  (3.62),  the  difference  equation  for  /A  is 
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With  L  defined  in  eauation  (3.66)  and  Ac  =  0  > 
K  ‘ 
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Substituting  equation  (3.68)  into  (3.63),  the  difference 
equation  for  Ap  is 
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3y  defining 
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equation  (3.69)  can  be  split  into  two  difference  equa¬ 


tions 
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The  Lyapunov  function  becomes 
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where  /V  ,  p  1  ,  and  P  are  defined  by  eauations  (3.65), 
XK  K  "K 

(3.71),  and  (3.72),  respectively.  The  first  quadratic 
term  is  the  discrete  controller  Lyapunov  function,  the 
second  term  is  the  discrete  observer  Lyapunov  function, 
and  the  third  term  is  an  additional  term  that,  like  in 


continuous- 


:ase,  reflects  the 


:rol  law  due  to  the  inaccuracy  of  tne  si 


estimate 


from  the  filter.  Note  that  P  (eouation  3.72'  is 
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affected  by  both  the  Kalman  gain,  KR ,  in  ,  and  the 
control  law  gain,  L„ .  The  question  arises  as  to  whether 

l\ 

equation  (3.74)  is  a  valid  Lyapunov  function  for  the 


linear,  d isc rete- time  ,  closed-loop  system, 


3.3.2  Lyapunov  Function  Validation 

Proposition  3.2 

VK(xK,eK, tR)  from  equation  (3.73)  satisfies  the 
sufficiency  conditions  for  asymptotic  stability  in  the 
sense  of  Lyapunov  for  the  discrete,  time-varying  system 
described  in  equations  ( 2 . 76 ) - { 2 . 77 )  under  the  assump¬ 
tions  that  (AK,BR)  and  (AK,Pp.)  are  controllable  and 

1  /2 

( A  k  r  H  k  )  and  (AK,Q„  )  are  observable.  The  control  gain, 

K 

Lr,  and  the  Kalman  gain,  KR ,  are  chosen  as  the  optimal 
values  (equations  2.26  and  2.54). 

Proof  : 


3y  assuming  ( AK , SR)  and  ( ,PK)  are  controllable 


and 

(Af,,HK)  and  (Ak,QJ/2)  ar 

Ex 

e  observable,  A,  , 
XK 

which  is 

the 

control  Riccati  matrix 

( eqo 

ation  3.65), 

-..o  -  K  , 

which 

is  the  observability 

Grammian  matrix 

( equation 

3.71) 

,  are  positive  definite 

for 

K  >  O  and  bounded.  With 

P  -1 

K 

positive  definite  and 

P 

eK 

positive  semidefinite 

[25]  , 

Ap  is  positive  definite 

K 

from  equation 

(3.70) . 

This 

impl  ies 

WeK'V  >  0 


’3.75. 


fot  bp.  =  N,...,l  and  all  xK  and  eK  not  equal  to  zero 


Therefore,  the  first  three  Lyapunov  function  require¬ 
ments  of  Section  2.2  are  satisfied.  Looking  at  the  fol¬ 
lowing  difference  equation 


AVK  =  VK+1  ‘  VK 


[XK  S K ^ 


‘LKRKLK"2c, 


T 

jkrklk 


lkrklk 


'LKRKLK~Qe 


K 


eK 


=  [XT  aTlQ  • 

-  1  K  “KJUK  |e. 


Rewriting  Q  '  as 
K 


0  !  = 
K 


r  lti 

"-Q„  0  ' 

lk 

-lt 

rk[lk  “lk1  + 

WK 

0  -Q 

lk 

L  K 

(3.76) 


(3.77) 


(3.78) 


it  is  obvious  that  for  R  >0,  the  first  quadratic  matrix 

in  (3.78)  is  negative  semidef inrte  ,  and  for 

Q„  _>3  and  Qq  _>0 ,  the  second  matrix  in  (3.78)  is  negative 
w  K  ”K 


semidef inite .  In  addition,  the  controllability  and 

ooservabil  ity  conditions  assure  that  Avi,  =  0  only  when 

K 

x^=0.  Therefore, 


AVr (xK,eK,tR)  <0  ,  K  =  N , . . . , 1  (3.79) 


for  x^^C  ,  which  satisfies  the  fourth  requirement  of 


Lyapunov 


f unction . 


The 


controllaoil i tv 


3  no 


observability  conditions  insure  that  Ay„ (xv ,e„ , t„) /0 

K  K  K  K 

except  at  x  =0;  thus,  the  system  described  by  equations 

A 

( 2 . 76 ) - ( 2 • 77 )  is  asymptotically  stable  in  the  sense  of 
Lyapunov  [121].  Therefore,  equation  (3.73)  represents  a 
good  Lyapunov  function  for  the  discrete,  cascaded, 
linear,  closed-loop  system. 


remains  stable  [122].  The  purpose  of  this  section  is  to 
develop  the  means  of  analyzing  the  stability  of  time- 
varying  systems  through  the  use  of  Lyapunov's  second 
method.  The  first  step  is  to  expand  the  Lyapunov  func¬ 
tions  derived  in  Section  III,  to  account  for  parameter 
variations.  Then,  as  in  Section  III,  a  Lyapunov  func¬ 
tion  is  derived  to  account  for  parameter  variations  in 
the  dynamic  and  measurement  models. 

The  first  step  in  this  section  is  to  identify 
these  parameter  uncertainties  and  incorporate  them  into 
the  linear,  time-varying,  cascaded  closed-loop  system 
model.  Then,  as  before,  the  1 inear-quadratic-Gaussian 
optimization  problem  is  solved,  subject  to  these  new 


dynamic 

constraint  equ 

ations  . 

From 

this 

opt imi za 

tion 

problem , 

a  new  Lyapunov 

function 

is 

derived 

which 

con- 

s  i  d  e  r  s  v 

'ariations  in  t  n 

e  dynamic 

and 

measurement  mod 

a  1  - 

This  der 

ivation  is  done 

for  both 

the 

continuous-time 

and 

discrete-time  systems. 

4.2  Continuous ,  Linear  ,  Time-Varying  Systems 

4.2.1  Extension  of  Lyapunov  Func t i on  From  Section  3.2.1 

The  Lyapunov  function  for  the  continuous, 
linear,  time-varying  system  without  parameter  uncertain- 


ties  is  rewritten  as 


y  (  t)  =  H  (t)  x  (  t)  -  M  ( t)  Lc  ( t)  x  ( t) 


(4.8) 


where  A,  B,  H,  and  M  are  the  unknown  true  system  parame¬ 
ters,  and  A  B  H  M  K  and  l„  are  tne  designed 
c,c,c,c,c,  c 

(or  nominal)  system  parameters.  Define  the  modelling 
errors  (or  deviations  from  the  nominal)  as 


Aft  =  A  -  A, 


(4.9) 


A3  =  B  -  8„ 


(4.10) 


Ah  *  h  -  h 


(4.11) 


Am  *  m  -  m. 


(4.12) 


Tne  svste' 


dynamics  can  be  rewritten  to  emphasiz; 


modelling  errors  in  the  following  way 


x(t)  =  ( A„  ( t )  -  S„(t)L„(t)  +  D,  n  ( t)  )  x  { t) 


+  ( S  ( t )  L„  ( t )  +  DR(t)  )  eft) 

C  D 


(4.13: 


where 


DAB(t) 


=  (Aft)  -  A_,  ( t )  )  -  (  B  (  t )  -  B„  ( t)  )  L„  ( t)  (4.14) 


=  (  3  ( t )  -  5  „  {  t  S  )  L  „  ( t ) 


(4.13) 


The  estimation  error,  defined  as 


e{t)=x(t)-x(t)  (4.16) 

has  the  following  dynamics 

eft)  =  D ( t) x ( t)  +  ( Ac ( t ) -Kc ( t ) Hc  (  t)  +  DgM  ( t)  )  e ( t)  '4 . 17  ) 
where 


D(t)  =  (A't)  -  A  (t)  )  -  K_  ( t)  (H(t)-H  (t)  ) 

-  (B(t)-B„  (t)  )  L„  (t)  +  K  „  ( t )  (M(t)-M„(t))L_(t)  (4.18) 

0BM(t)  =  (B(t)-Bc(t))Lc(t)-Kc(t)  (M(t)-Kc(t))Lc(t)  (4.19) 
Therefore,  the  closed-loop  system  is 


X  (  t) 

II 

- 1 

_e  ( t)_ 

L 

t.>  -c  .  > 

D(t) 


(Bc(t)Lc(t)+DB(t)  ) 


(Ac(t)-Kc(t)Hc(t)+DBM(t)  ) 


’  [SUi] 


(4.20) 


Equations  (4.2)  and  (4.4)  can  be  rewritten  as 


0  X  '  w 

/\p{t)  L  0  ^ 


Aft)  B  ( t )  L  ( t ) 

(t)ii  0  f: 


Aft) 


— T 

A  (t) 


l/  (t)  B‘  (t) 


~T 

A1  (t) 


\{t) 

0 


/'p  (t) 


C  -LT(t)  R(t)  L(t) 


-L*  ( t )  R  ( t )  L  ( t )  L  (t)R(t)L(t)+Q  (t) 


Incorporating  the  effects  of  the  model ling  errors 
this  equation  results  in 


Aj<(t)  0 

’\{t) 

0  ' 

A’  (t) 

B  1  (t) 

0  Apft) 

+ 

0 

Ap(t) 

D(t) 

A ’ (t)_ 

Fa’T( 

i 

LB'- 

z ) 

T  1 

D  ft) 

>  1  -*■  w  ' 

'\(t) 

3 

— 

0  1 

/ 

X>  ' 

-J 

'  t)  R  (t)  L„  ( t)  +Q_  ( t)  -L*  ft)  R  ft)  L„  { t) 


( t )  R  ( t )  L  ( t ) 


-1  ( t  i  R  i  t j  L  (  1 1  +Q  ( t , 


/x  { dab*dab/x  { /Ax  (  /'v(t 


Aw  {  t)  D„M-!-D"  A  ft) 


(4.21) 

in  tc 


/-  r t )  d+d:a„  ( t) 


(4.22) 


B'  (t) 


(4.24) 


=  Bc(t)Lc(t)  +  DB(t) 

A  '  ( t)  =  A  c  (  t )  -  Kc(t)Hc(t)  +  Dbm  ( t )  (4.25) 

This  has  not  altered  the  solution  to  A^(t)  and 
which  implies  that  V(x(t)  ,e(t)  ,t)  is  still  positive 
definite.  However,  the  sufficient  condition  for  V  to  be 
negative  semidefinite  is  that  the  right  side  of  equation 
(4.22)  be  negative  definite  for  x(t)=0.  i.e. 

L  J  ( t)  R  ( t)  L  (t)+Q  (t)  -lJ  (t)  R  ( t>  L  ( t) 

-L^(t)R(t)Lc(t)  L^(t)R{t)Lc(t)+Qe(t) 

+  f\(t)DAB+DAB\(t)  /\(t)DB+DT/V(t)  I  0  (^26) 

^  (li  y  It!  /p  V)  B  ( 1 1 

This  inequality  constraint  becomes  the  sufficient  condi- 
*-  -  ->  p  f  o *z.  n  s  ci  Icon  s  v  s  t.  0  t,  c  o  0  0  scanIa  in  c  h  0 

sense  of  Lyapunov.  It  is  possible  that  for  certain 
ranaes  of  parameter  uncertainty,  the  inequality  con¬ 
straint  (equation  4.26)  could  be  violated. 

4.2.2  Lyapunov  Function  Per ivat ion 

The  continuous,  linear,  time-varying  closed-loop 
svstex:  dvnamics  with  parameter  uncertainties  are 


Ap  (t)  , 


x(t}  = 

_e  ( t )  J  L 


(AC  t»-Bc(t)  Lc(t)+D^B(t)  ) 


(Bc(t)Lc(t)+DB(t)) 

(Ac(t)-Kc(t)Hc(t)+DBM(t)) 


(4.27) 


For  the  linear,  t ime- inv ar iant  system,  it  is  easy  to  see 
how  the  uncertainty  parameters  (D,D_U  D>0,  and  D_)  can 

O  rl  f  A.*J  D 

affect  the  stability  of  the  system.  Without  these 
parameters,  the  stability  of  the  system  is  characterized 
by  the  eigenvalues  of  the  controller  and  the  observer, 
designed  separately  [122].  This  can  be  used  tc  deter¬ 
mine  acceptable  bounds  of  parameter  variations,  under 
which  the  system  remains  stable.  It  is  desirable  to 
provide  the  same  kind  of  stability  analysis,  given 
parameter  variations,  for  linear,  time-varying  systems. 
Tnis  is  accomplished  through  the  following  derivation  of 
a  L'-’aounov  function  tr.  at  accounts  for  variations  in 


parameters.  Using  the  same  optimization  technique  set 


up  m  the  previous  section. 


chosen  as 


:he  oerformance  index  is 


+  f  /  fxT(t)Q  (t)x(t)  +  eT(t)Q  (t)e(t) 


+  u  *  ( t)  R  ( t)  u  ( t)  ]  dt 


(4.28) 


subject  to 


x  ( t )  =  A  '  ( t)  x  ( t)  +  B'(t)e(t)  +  P  ( t )  uj  ( t )  (4.29) 

•  mm 

e(t)  =  D  ( t)  x  ( t)  +  A  '  ( t)  e  ( t)  -  Kc  (  t )  (/( t )  +  P(t)uj{t)  (4.30) 
where 


LU(t)  _  N  ( 0  ,  Q  ( t )  6  ( t  -  T)) 

("t)  _  n  ;  3  ,  r  ( t )  6  ( t  -  r;  )  (4.31) 

u(t)  =  -L„(t)  [  x  { t )  -  e  ( t )  )  (4.32) 

Rewriting  the  performance  index  in  cerms  of  x(t)  and 
e(t)  ,  and  carrying  through  the  expectation,  equation 


(4.28)  becomes 


tf  L~(t)R(t)L  (t)+Q  (t) 

+  f  tr  C  C 

V  0  T 

-L^(t)R(t)Lc(t) 


-L^  ( t)  R  { t)  Lc  (t) 


I*(t)R(t)Lc(t)+Qe(t)J  [sT(t>  P(t) 


X(t)  S(' 


(4.33) 


where 


X  ( t)  =  E  [  x  ( t)  xT  ( t)  ]  ,  S(t)  =  E[x  (t)  eT(t)  ] 


P(t)  =  E  [e  ( t)  e  ( t)  ] 


(4.34) 


Using  tne  same  technique  in  Appendix  3,  the  differential 
equations  for  X(t',  S(t),  and  P(t)  are 


X(t)  S(t) 

*  T  ?  ( t  i 

S  (t) 


r_  i  r  •* 

A'  (t)  3'  (t)  lx  (t)  3  (t) 

.  A(t)J[s*(t)  ?(t) 


X(t)  S(t) 
ST(t)  P(t) 


A  '  T  ( t 
_3  1  T  ( t 


(t)  D  ( t) 


)  A  '  ( t ) 


(4.35) 


12  ( t)  K(t)R(t)K*(t)  -2  ( t) 


Following  the  same  steps  in  Section  3.2.1,  cost  function 


*WSW 
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can  be  rewritten  as 


J’  =  E  [V  ( x  ,  e  ,  t )  ]  +/0  tr.AQdt 
where  V  is  a  Lyapunov  function  of  the  form 


(4.36) 


V(x(t)  ,e  ( t)  ,t)  = 


T  T 

[xMt)  e1  ( t)  ] 


/\(t)  As(t) 


Ag  ( t)  Ap(t) 


rx(t)-i 
Le  ( t )  j 


(4.37) 


where 


'Vt) 

As(t> 

Avi 

Ajlt)' 

Ta’  (t)  B’  (t) 

'  T 

A^(t) 

Ap  (t) 

A(t) 

Ap  ( t } 

|.D(t)  A'(t)_ 

( t) 


T 

D1  (t) 


B,T  (t) 


A  ,T(t) 


Ag  (t) 


Ag(t)  ,Ap  ( t) 


L* (t) R (t) Lc (t) +2C (t) 
-L^(t)  R(t)  L„  (t) 


-l;  (t)  r  (t)  ( t) 


L*(t)R(t)Lc(t)+Qs(t) 


A'tfl  W' 

fGf  0  ' 

A^(tf> 

"  |_0  0 

(4.38) 


With  parameter  uncertainties  in  the  Lyapunov 
function,  A^(t)  is  no  longer  equivalent  to  the  con¬ 


troller  Riccati  matrix  which  implies 


L= (t)  /  R  ( t )  ( t)A^ ( t) 


(4.39) 


In  addition,  /\,(t)  is  not  equal  to  zero  even  with  Ag(t^) 
equal  to  zero.  Therefore,  the  Lyapunov  function  (equa¬ 
tion  4.38)  cannot  be  simplified. 


4.2.3  Lyapunov  Function  Val idation 


Prooosition  4.1 


V(x,e,t)  from  equation  (4.37)  satisfies  the  four 
sufficiency  conditions  for  asymptotic  stability  in  the 
sense  of  Lyapunov  for  the  continuous,  time-varying  sys¬ 
tem  described  in  equations  ( 2 . 64 ) - (2 . 66 )  when  subjected 
to  system  parameter  uncertainties  of  the  form  described 
in  equations  (4.14),  (4.15),  (4.13),  and  (4.19)  under 

the  assumptions  that  (  M  t)  ,  3  ( t)  )  and  ( A ( t)  ,P  ( t) )  are 


' .--  ( t )  ,  H  '  1 1  ) 


1  /? 

i  t  'i  ^ 


ooservable  [121].  Thus,  V(x,e,t)  is  positive  definite 
and  bounded ,  i . e . , 


0  <  V  (x  ( t)  ,  e  ( t )  ,t)  <  P(|  |x||,|  lei  I) 


(4.40) 


w.ner  e 


L*(t)R(t)L  (t)+Q„(t)  -L^(t)R[t)L„(t) 

Q (t) =  “  T  T  ~  (4.41) 

-L;(t)R(t)L„(t)  L^(t)R(t)L„  (t)+Q_  (t) 

„  ^  w  tr 

and  <?>(t0,r)  represents  the  state  transition  matrix  for 
the  system  defined  in  equation  (4.27)  and  |B  is  a  con¬ 
tinuous  nondecreasing  scalar  valued  function. 

Proof  : 

For  R(t)>0,  Q„(t)_>0,  and  2o(t)^0,  then  C(c'O0  as 
shown  in  equation  (3.39).  Tnis  assures  that  equation 
(4.41)  is  nonnegative  definite  for  t>t„  [25].  In  order 

xJ 

tnat  V(x,e,t)  satisfies  the  sufficiency  conditions  for 
asymptotic  stability  in  the  sense  of  Lyapunov,  the  ine¬ 
quality  constraint  (equation  4.40)  must  be  satisfied. 
With  equation  (4. 40),  the  first  three  requirements  for 
the  Lyapunov  function  are  satisfied.  Taking  the  deriva¬ 
tive  of  equation  (4.37) 


T  T  “ L '  ( t )  R(t)L  (t)-Q  (t) 

V (x ( t)  / e ( t)  ,t)  =  [xA(t)  e 1 ( t) ]  u 

L  (t)R(t)L„(t) 


Lc(t)R(t)Lc(t)  pc  ( t ) 
■L^(t)  R(t)  L  (t)  -Q  (  t)  LS(t). 


(4.42) 


This  is  similiar  to  equation  (3.38)  and  is  negative 
definite  for  x{t)/0  and  given  any  uncertainty  of  the 
form  described  in  equations  (4.14),  (4.15),  (4.18),  and 

(4.19).  For  equation  (4.37)  to  be  a  valid  Lyapunov 
function  for  all  x(t)  and  e(t) ,  equation  (4.40)  must  be 
satisfied  . 


4.3  Discrete-Time  Linear  Systems 


4.3.1  Extension  of  Lvaounov  Function  From  Section  3.3.1 


The  Lyapunov  function  for  the  discrete- time , 
linear  system  without  parameter  uncer ta inties  is  rewrit¬ 
ten  here  as 


Ay  0 
T  T,  K 


V  =  f  X  »  I 
K  1  K  K  0 


(4.43) 


where 


axk  =  -VScr+1ak  +  'jKRKLK  +  2c„  '  ~  GN 


bk+rk)Lk 


V  'p 


K  +  l 


VBA 


K  +  l 


+  Qp  ,  Ap  =  0  (4.45) 

K  N 

The  discrete-time,  linear  closed-loop  system 
dynamics  are 


‘K+l 


=  (AK"BKLc 


)  x, 


BKL: 


(4.46) 


K+l 


)  xi 


+  K 


r 


(4.47) 


^k  =  hkxk  -  (4-48) 


X.  =  (A„  -  B„  )x  (4.49) 

“ K  “R  "'K 


K  =  [H  P_  H*  +  R  I'1  (4.50) 

K  “K  WK  K  K  ^ K 


wnere  A  Bv  and  M„  are  the  unknown  true  svstem 

parameters,  and  A„  B„  H  M  K„  and  L_  are  the 

CK,  CK,  C  K ,  CK,  C  K ,  CK 

designed  (or  nominal)  system  parameters.  The  discrete 
modelling  errors  (or  deviations  from  the  nominal'  are 
defined  as 


»  X  v_  X  -  »  i  *  _■  »  I."*  vv  1  »  t  - ■  ;  ■.  >  1  -»  .  .  ^  "w  «  "k.  '  *V  .  H-/  -_  w  K.  *. 
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=  \  -  Ac. 


(4.51) 


*  BK  "  Bc, 


(4.52) 


=  HK  “  Hc, 


(4.53) 


AMK  =  MK  -  Mc 


(4.54) 


K 


The  system  dynamic  can  be  rewritten  to  emphasize 
:he  modelling  error  in  the  following  way 


XK  +  1  =  {AC  -Bc„Lc„  +  DABjXK  +  (Bc„Lc„+DB„,eK  (4-55) 


'  K  K  K  K 


'K  K  K 


where 


Drn  =  (Ak-A„  )  -  (Bl,-3„  )L 


in  c  c  „ 

k  i\ 


D  =  (B  -  3  )L„ 

BK  K  K  "K 


(4.57) 


Tne  discrete  estimation  error,  defined  as 


SK  ~  XF  "  XK 


(4.58) 


has  the  following  dynamics 


e  =  D  x  +  (A„  -K„  H  A„  +D  ) e„ 
K  k  -K  -K+1  CK  +  1  bmk  k 


(4.59) 


where 


-  K  ^ 

CK+1 


Therefore 


(A  -B 
K 


Equation 


Incorpora 


°K  =  (AK-AckJ  -  (BK‘BCK)LCK 


(H„  ,-H„  )  A  +  K  ( Mj.  ,  -M  )  L  A„  (4.60) 

K+i  wR+1  K  CK+1  K+l  -R+1  CK+1  K 


(B  -B  ) L  -  K„  (M  -M  )L„  A  (4.61) 
K  CK  C  K  "K  +  l  K  +  i  C  K  +  l  "K  +  l  K 


,  the  discrete  closed-loop  system  is 


[XK+1"] 

[eK+lJ 


'  LC  +°AB  } 
'K  K 


(B  L  +D  ) 
C K  °K  BK 


K 


(A„  -K 


H„  A„  +D  ) 
K  "K+l  "K+l  "K  K 


(4.62) 


(4.44:  and  (4.45 


oe  r ewr i 1 


— T 

a.;  0 


■k3k  q 


7\  0 

XK  +  1 


K  +  l 


ak  bklk 


f/v 

XK 

0  * 

lkrklk+qc„ 

K 

'lkrklk 

0 

i 

u: 

'lkrklk 

Km 

(4.63 


:ina  the  effects  of  the  modelling  errors  into 


eauation  (4.63) 


tne  result  is 
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As  in  the  continuous- time  case,  this  does  not 

alter  the  solution  to  and  Ap  ,  which  implies  that  V.. 
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This  inequality  constraint  becomes  the  suffi¬ 
cient  condition  for  the  discrete  closed-loop  system  to 
be  stable  in  the  sense  of  Lyapunov.  For  certain  ranges 
of  parameter  uncertainties,  it  is  possible  that  this 

inequality  constraint  could  be  violated. 


4.3.2  Lvaounov  Function  Derivation 


The  discrete-time,  linear  closed-loop  system 
dynamics  with  oarameter  uncertainties  are 
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A  means  of  analyzing  the  stability  of  linear, 
d iscrete- time  systems  subject  to  parameter  variations  in 
developed  in  this  section.  This  is  accomplished  through 
the  following  derivation  of  a  Lyapunov  function  which 
accounts  for  variations  in  parameters.  The  discrete  LQG 
oerformance  index  is  chosen  as 
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Following  the  same  steps  in  Section  3.3.2,  the  cost 
function  can  be  rewritten  as 
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where  V  is  the  discrete  Lyapunov  function  of  the  form 
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As  noted  in  Section  4.2.2,  A,  is  no  lonoer 

XK 

equivalent  to  the  controller  Riccati  matrix  with  parame¬ 
ter  uncertainties  present  which  implies 
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In  addition,  /v  d  0  for  K  =  N-l , . . . , 8 ,  even  with 

K 

A\<-  =0.  Therefore  the  Lyapunov  function  cannot  be  sim- 

“N 

pi  if ied  . 


4.3.3  Lvaounov  Function  Validation 


ProDOSition  4 . 2 


VR(xK,eK,tK)  from  equation  (4.79)  satisfies  the 
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sufficiency  conditions  for  asymptotic  stability  m  the 
sense  of  Lyapunov  for  the  discrete,  time-varying  system 
described  in  equations  (2 . 75 ) - (2 . 76 )  when  subjected  to 
system  parameter  uncertainties  of  the  form  described  in 
equations  (4.56),  (4.57),  (4.63),  and  (4.61)  under  the 


assumptions  that  (AR,BK)  and  ( AR , PK )  are  controllable 


and  (Ar,Hk)  and  (A^Q*' 


are  observable.  Thus, 


VK(xR,eK,tK)  is  positive  definite  and  bounded,  i.e., 
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and  Avr^0  except  at  xR=0  [96],  where  is  a  nondecreas- 


ino  scalar  valued  function. 


Proof  : 
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For  w ^>2  and  _>0  >  tnen  /v>0  for  K_>  0 .  For  equation 
(4.79)  to  satisfy  the  sufficiency  conditions  for  asymp¬ 


totic  stability  in  the  sense  of  Lyapunov,  must  be 

f\ 

positive  definite  for  K>2  and  all  nonzero  x  and  e„  and 

i\  K 

bounded  from  above.  Tne  first  three  reauirements  for  a 


Lyapunov  function  are  satisfied  if  equation  (4.82)  is 


valid.  The  difference  equation  of  V  is 

K 


This  is  similiar  to  equation  (3.76)  ,  and  is  negative 

definite  for  XK.^2  and  for  any  uncertainty  of  the  form 

described  in  equations  (4.56),  (4.57),  (4.60),  and 

(4.61),  since  equation  (3.76)  is  independant  of  the 

variations.  For  equation  (4.79)  to  be  a  valid  Lyapunov 

function  for  all  x„  and  e,, ,  eauation  (4.82)  must  be 

r\  K 

satisfied  . 

4  .  4  Practicality  of  T  r.  i  s  Derived  Lyapunov  Function 

Section  4.2.3  and  4.3.3  have  provided  suffi¬ 
ciency  conditions  under  w.nich  equations  (4.37)  and 
(4.79)  are  valid  Lyapunov  functions.  Considering  the 
d isc r ete- time  case  only,  equation  (4.80)  is  a  backward 
difference  eauation  of  the  form 


(4.36) 


^ 


where  K=N-1,...,0.  represents  a  state  transition 
matrix.  In  addition,  is  positive  semidefinite  from 
equation  (3.78).  Stability  in  the  sense  of  Lyapunov  is 
only  applicable  to  an  infinite  time  problem.  For  the 
finite-time  problem,  the  Lyapunov  function  does  not  pro¬ 
vide  a  measure  of  stability;  however,  by  investigating 
the  time  response  of  the  Lyapunov  equation,  a  measure  of 
system  performance  can  be  obtained.  In  particular,  the 
Lyapunov  equation  becomes  unbounded  from  above  when  the 
system  performs  poorly. 


With  Gn>0  and  Qj,_>0,  Aj,  will  always  be  at  least 
positive  semidefinite.  Variations  in  the  systems  param¬ 
eters  will  not  cause  to  become  nonpositive  definite, 
nor  will  it  cause  to  become  nonnegative  semidefin¬ 

ite.  However,  these  variations  can  cause  V  to  oecome 
unbounded  from  above. 


When  the  variations  in  system  parameters  become 
large  enough  to  cause  the  system  to  diverge  (or  perform 
poorly)  ,  the  solution  to  the  Lyapunov  equation  goes  to 
infinity  (becomes  unbounded  from  above).  This  charac¬ 
teristic  of  the  Lyapunov  equation  is  useful  in  providing 
a  measure  of  system  performance  for  the  linear,  time- 
varying,  finite-time  problem. 


•r 


For  the  linear,  time- invar lant  problem,  it  is 
possible  to  analyze  the  steady-state  value  of  the 
Lyapunov  function.  In  steady-state,  equation  (4.85) 
becomes 


ASSAASS  +  2SS 


(4.87) 


where  ()  represents  steady-state  values.  It  is  nov 
possible  that,  for  certain  regions  of  parameter  varia¬ 
tions,  A,  may  not  be  positive  definite. 
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SECTION  V 


MISSILE  OBSERVER  PERFORMANCE  IMPROVEMENTS 


THROUGH  OPTIMAL  FEEDBACK  CONTROL 


5.1  Introduction 


The  application  of  Linear  Quadratic  Gaussian 
( LQG )  optimal  control  theory  to  the  tactical  missile 
guidance  problem  has  drawn  much  attention  in  recent 
years.  It  has  been  demonstrated  that  for  short  range 
tactical  missiles,  the  LQG  guidance  law  provides  signi¬ 
ficant  performance  improvements  over  the  more  commonly 
used  classical  proportional  navigation  (  pro-nav  )  gui¬ 
dance  laws  [109]  . 

A  critical  issue  that  affects  the  performance  of 
the  LQG  guidance  law  is  the  fact  that  it  is  a  function 
of  missile- to-target  position,  velocity,  and  accelera¬ 
tion,  and  time-to-go.  Time-to-go  is  usually  approximat¬ 
ed  as  a  function  of  the  position,  velocity,  and  ac¬ 
celeration.  A  more  detailed  discussion  is  presented  in 
Section  VI.  In  the  derivation  of  the  guidance  law  it  is 
assumed  that  this  information  is  accurate  and  available 
on  board  the  missile.  Most  present  day  missiles  can  ob¬ 
tain  a  measure  of  the  missile's  acceleration  through 


v.vvv'.'yvvv 


mm 


on-board  accelerometers. 


In  addition,  passive  seekers 


are  used  to  provide  a  measure  of  1  ine-of-sight  angle  and 
r ate  . 

Extended  Kalman  filters  have  been  used  to  esti¬ 
mate  the  needed  guidance  information  from  the  informa¬ 
tion  available  on  board  the  missile  with  very  good 
results  in  terms  of  minimizing  miss  distance  at  final 
time  [109].  However,  in  many  instances,  the  estimates 
from  the  filters  have  not  been  very  good,  partially  be¬ 
cause  it  is  impossible  to  accurately  model  the  target 
acceleration.  Although  not  the  subject  of  this  disser¬ 
tation,  much  work  has  been  accomplished  toward  improving 
target  acceleration  modelling. 

In  addition,  certain  missile/target  engagements 
reduce  the  observability  of  the  filter  states;  thus,  de¬ 
grading  the  performance  of  the  filter,  and  in  turn,  the 
guidance  law.  The  emphasis  in  this  section  is  to  im¬ 
prove  the  state  estimates  through  the  guidance  law.  As 
in  the  previous  sections,  an  observer  will  be  used  in¬ 
stead  of  a  filter  algorithm. 

The  task  is  to  incorporate  an  additional  term  in 
the  LQG  performance  index,  which  is  developed  to  minim¬ 
ize  final  miss  distance  while  minimizing  control  effort. 
This  new  term  is  included  to  maximize  the  observability 
Grammian  matrix  of  the  observer,  i.e.,the  measure  of  the 
uncertainty  of  the  state  estimates.  Tnis  new  term  will 
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require  the  guidance  law  to  minimize  the  error  variance 
matrix  of  the  observer.  This  is  similar  to  the  efforts 
by  Hull,  Speyer,  Tseng,  and  Larson  [63,123],  in  which 
they  developed  a  guidance  law  using  the  LQG  performance 
index  w.oich  included  a  term  that  would  maximize  the  in¬ 
formation  matrix.  This  guidance  law  could  not  be  solved 
in  closed  form  requiring  the  use  of  a  numerical  optimi¬ 
zation  program.  The  results,  however,  did  show  that  the 
guidance  law  could  improve  the  filter  algoritnm's  per¬ 
formance  while  attempting  to  hit  the  target. 

The  impetus  for  this  work  comes  from  the 
Lyapunov  stability  analysis  of  the  pseudomeasurement  ob¬ 
server  ( ?M0 )  in  Section  II.  By  taking  advantage  of  the 
PMO's  algorithm,  a  closed  form  solution  is  obtainable. 

5 . 2  .Missile  Model 

The  state  dynamics  model  used  for  the  develop¬ 
ment  of  botn  the  missile's  guidance  law  is  linear  and 
the  estimation  algorithm  is  nonlinear  and  they  are  set 
up  in  rectangular  coordinates  as  follows: 


and  x  consists  of  the  three  components  of  missile-to- 
target  position,  velocity,  and  target  acceleration  in 
inertial  coordinates. 

The  1 ine-of-sight  angles,  measured  from  a  pas¬ 
sive  seeker,  are  azimuth,  (9),  and  elevation,  (b), 
angles.  The  relationship  between  these  angles  and  the 
observer's  states  is  illustrated  in  Figure  5.1. 


Figure  5.1,  Angular  Measurements  Related  to  Observer  Stc 

The  nonlinear  functions  relating  the  angles  to  the 
states  in  a  rectanaular  coordinate  frame  are 
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where  X,  Y,  and  Z  are  the  three  components  of  relative 
position  in  inertial  coordinates. 

For  the  PMO,  the  measurement  model  is  rewritten 
as  [119,120] 


y  =  H  ( 2)  x 


(5.6) 


where 
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.2  Got  irr. i za t  ion  Proolem 


Consider  the  following  performance  index 


J  =  0f  (uTRu  -  xTQx )  dt 


(5.8) 


subject  to 


Dx  =  0 


(5.9) 


x  =  Ax  +  Bu  ,  x ( 3 )  =  x, 


(5.10) 


is  given,  R  is  positive  definite,  and  Q  is 


where  t, 


positive  semidef inite .  This  performance  criteria  is 

chosen  to  require  the  control  law  to  drive  the  system  to 

a  zero  terminal  miss  while  minimizing  the  control 

T 

effort.  In  addition,  there  is  the  term  (x  Qx)  which  is 
maximized  over  time.  This  term  is  constructed  to  maxim¬ 
ize  some  measure  of  the  observability  Grammian  matrix  of 
the  observer;  thus,  minimizing  the  error  variance  matrix 
of  the  observer.  The  differential  equation  for  the 
observability  Grammian  matrix  for  the  PMO  is 


P  -  AP  -  PAT  +  PHT  (z)  V‘1H  (z)  P  -  w  =  0  (5.11) 


where  V  is  the  power  spectral  density  of  the  measure¬ 
ments  and  W  is  the  power  spectral  density  of  the 
observer  states.  Taking  the  inverse  of  the  observabil¬ 
ity  Grammian  matrix,  the  differential  equation  oecomes 

'-1  -i  T  -1  t  -]  -1  -] 

P  +  P  \A  +  A  P  -  H  (z)V  H  *  P  WP  =  0  (5.12) 

The  results  of  the  Lyapunov  stability  analysis 

of  Section  II  showed  that  by  decreasing  V  (or  increasing 

V-^)  ,  the  inverse  observability  Grammian  matrix  (P  ^ ) 

would  increase.  Therefore,  the  performance  index  should 

T  - 1 

include  a  term  to  maximize  H  (z)V  H(z)  ,  where  H(z)  is 
defined  in  equation  (5.7).  The  measurement  power  spec¬ 
tral  densitv  is  assumed  to  be 
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V  =  c(  (5.13) 

where  and  q  is  some  positive  constant  representative  of 
the  accuracy  of  the  infrared  passive  seeker. 

Define  the  second  term  in  equation  (5.8)  as 


xTQx  =  tr  (R2HT(x) V-1H  (x)  }  (5.14) 

where  R  is  range  and  H(X)  comes  from  substituting  the 
following  identities  from  Figure  (5.1)  into  equation 
(5.7) 

sin©  =  — — l -  (5.15) 
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cos©  =  — — -  (5.15) 
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Note  that 


tr  {  R  H  ( X )  V  H  ( x )  }  =  tr  [R  V  H(x)H"(x) 
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With  equation  (5.14),  the  following  definition  of  Q  can 
be  made 


(5.20) 
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The  solution  to  this  optimization  problem  is  [38] 
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u  =  -R  J'B 1  (S-GQ  -S'-Jx 


wher  e 


S  =  -SA  -  ATS  +  SBR-1STS  +  Q  ,  S(tf)=0  (5.22) 


G  =  -(AT  -  S3R_1BT)G  ,  G(tf)  =  DT  (5.23) 


Q  =  GTBR  1BTG  ,  Q(tf)  =  0 


(5.24) 


5.4  Design  Considerations 


To  ensure  that  no  cor. jugate  points  exist, 


5.22).  With  Q  positive  semidef inite ,  it  is  possible  for 

S  to  blow  up  if  integrated  over  a  long  period  of  time. 

- 1  T 

This  may  or  may  not  cause  (S  -  GQ  G  )  to  blow  up  [26]. 
This  potential  problem  puts  some  restrictions  on  the 
final  time  boundary  condition,  t ^ .  S  is  a  backward  Ric- 
cati  differential  equation  and  it  is  important  that  the 
critical  time,  t„  (where  the  conjugate  point  occurs)  , 
does  not  fall  between  the  integration  period  [t,  tCT). 

L  ,  V 

In  the  homing  missile  problem,  initial  time,  t0, 
is  known  but  final  time,  tf,  is  not  known.  A  restric¬ 
tion  on  tf  such  that  no  conjugate  point  occurs  is 


:f  "  fcc  >  tf  '  "  tg 


(5.25) 


tf  >  t„  +  t„ 
r  - 


’5.26) 


where  t  is  time-to-go.  The  conjugate  point  is  avoided 
through  the  selection  of  the  guidance  parameter,  c( .  A 
smaller  value  of  c(  will  lesson  the  rate  of  change  of  S, 

such  that  a  larger  interval  of  [tf  t0)  will  not  contain 

a  conjugate  point.  A  smaller  value  of  c(  implies  the 
measurement  device  is  more  accurate.  It  also  reduces 

the  emphasis  for  the  guidance  law  to  improve  the 
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SECTION  VI 


APPLICATIONS 


6.1  Introduction 


The  purpose  of  this  section  is  to  demonstrate 
the  usefulness  of  the  Lyapunov  functions  derived  in  Sec¬ 
tions  II,  III,  and  IV  tc  measure  the  stability  charac¬ 
teristics  (or  performance  for  time-varying  systems)  of 
various  closed-loop  systems  given  state  modelling  er¬ 
rors.  Several  simple  problems  are  used  to  obtain  in¬ 
sight  as  to  how  useful  the  Lyapunov  functions  are.  The 
analysis  is  broken  up  into  the  following  classes  of 


problems 


Linear,  Time-Invariant  Scalar  Proolem; 


Linear,  Time-Invariant  Multivariable  Control  Problem; 
Linear,  Tix.e-Var  vine  Guidance  Problem;  and  t.ne  Homing 
Missile  Guidance  Problem  with  Angle-Only  Measurements. 
In  addition,  the  performance  of  the  LQG  guidance  law 
developed  to  improve  the  observer's  state  estimation 
process  as  well  as  minimize  miss  distance  is  analyzed. 

The  linear,  time- invar iant ,  scalar  problem 
selected  comes  from  a  study  by  Speyer  [122],  in  which  he 
was  able  to  identify  acceptable  ranges  for  state  model¬ 
ling  errors  (  eqns.  4.S-4.12)  where  in  the  closed-loop 
system  would  remain  stable.  He  accomplished  this  by 


rewriting  the  system  equations  to  emphasize  the  model¬ 
ling  errors  (  Section  4.2.1  ).  Tne  acceptable  ranges 

were  identified  using  eigenvalue  analysis  under  steady- 
state  conditions.  Since  eigenvalue  analysis  represents 
both  a  necessary  and  sufficient  condition  for  the  sta¬ 
bility  of  a  linear,  time- invar iant  system,  a  comparison 
provides  the  basis  for  determining  how  accurate  the 
Lyapunov  functions  are  at  determining  stability. 

The  linear,  time- invar iant  multivariable  control 
problem  comes  from  the  work  by  Doyle  and  Stein  [41], 
where  the  closed-loop  system  is  marginally  robust.  By 
changing  the  power  spectral  density  of  the  state  equa¬ 

tions  for  the  estimation  algorithm,  they  were  able  to 
improve  the  robustness  characteristics  of  the  closed- 

loop  system.  This  would  allow  the  system  to  remain 
stable  for  larger  ranges  of  the  state  equation  modelling 
errors.  As  in  the  scalar  problem,  an  eigenvalue 

analysis  is  performed  for  the  various  power  spectral 

densities  that  Doyle  and  Stein  selected  to  provide  a 
basis  for  the  Lyapunov  function  analysis  under  steady- 
state  conditions.  This  analysis  is  performed  for  a 
range  of  state  equation  modelling  errors.  In  addition, 
simulation  results  are  obtained  to  demonstrate  the 
time-varying  traits  of  the  closed-loop  system. 

The  impetus  for  the  linear,  time-varying  gui¬ 
dance  work  comes  from  the  homing  missile  guidance  prob- 


lem,  which  can  use  the  LQG  guidance  algorithm.  The  LQG 
guidance  law  is  a  function  of  missile- to- target  posi¬ 
tion,  velocity,  and  target  acceleration,  as  well  as 
time-to-go.  Even  for  missile  systems  with  the  most  ad¬ 
vanced  measuring  devices,  this  information  is  not  readi¬ 
ly  available,  and  must  be  estimated.  To  do  this  effec¬ 
tively,  the  estimation  scheme  must  have  an  accurate 
model  of  the  missile/target  dynamics.  The  most  diffi¬ 
cult  information  to  model  is  time-to-intercept  (  or 
time-to-go  )  and  the  target’s  acceleration.  The  purpose 
of  this  effort  is  to  determine  if  Lyapunov  functions  can 
be  used  to  determine  acceptable  ranges  of  time-to-go  and 
target  acceleration  modelling  errors  under  which  the 
closed-loop  homing  missile  guidance  system  performs 
well.  Since  this  is  a  time-varying  problem,  it  is  not 
possible  to  look  at  steady-state  conditions;  and  there¬ 
fore,  eigenvalue  analysis  cannot  be  used  as  a  basis  for 
validity.  The  estimation  algorithm  used  for  this  study 
is  a  linear  Kalman  observer. 

The  next  example  is  the  homing  missile  guidance 
problem  with  a  passive  (  angle  only  measuring  )  seeker. 
These  types  of  seekers  are  common  for  tactical  air-to- 
air  and  air-to-sur face  missiles.  The  LQG  guidance  algo¬ 
rithm  presents  a  difficult  problem  for  the  estimation 
algorithm,  which  is  needed  to  estimate  miss  lie- to -target 
position,  velocity,  and  acceleration.  For  missile  sys- 


i 


terns  with  passive  (  angle  only  )  seekers  on  board,  the 
estimation  algorithm  has  not  been  very  successful  in  ac¬ 
curately  estimating  the  state  information  [127]; 
although,  the  guidance  law  has  still  been  successful. 
The  guidance  law  could  be  much  more  successful  if  the 
state  into rmation  were  more  accurately  known.  The  pur¬ 
pose  of  the  homing  missile  guidance  effort  is  to  deter¬ 
mine  if  Lyapunov  functions  can  be  used  to  identify  ac¬ 
ceptable  ranges  of  target  acceleration  modelling  errors 
under  which  the  system  performs  well. 

The  difference  between  this  analysis  and  the 
linear  time-varying  guidance  problem  .s  that  the  angle 
only  measurements  are  nonlinear  functions  of  the  system 
states,  and  therefore,  the  estimation  algorithm  is  non¬ 
linear.  Tne  estimation  algorithm  selected  for  this  part 
of  the  study  is  the  pseudomeasurement  observer  (PMO) . 
This  algorithm  was  selected  Decause  it  exhibits  global 
convergent  characteristics  [119,120]  unlike  the  more 
typically  used  extended  Kalman  observer  ( EKO )  . 

The  last  applications  problem  is  to  evaluate  the 
performance  of  the  LQG  guidance  algorithm  developed  to 
improve  the  estimation  algorithm's  ability  to  estimate 
the  state  information,  as  well  as  minimize  the  final 
miss  distance  (  hit  the  target  )  .  Tne  guidance  law  is 
designed  under  the  assumption  that  the  missile- to- target 
position,  velocity,  and  acceleration  are  available  and 


known  perfectly.  With  the  exception  of  the  missile's 
acceleration,  this  information  is  not  available  on-board 
a  homing  missile  with  angle-only  measurements.  The  gui¬ 
dance  law  developed  in  Section  V  is  demonstrated  in  a 
missile/target  two-deg r ee-of- f r eedom  simulation  using 
the  PMO  estimation  algorithm.  The  engagement  selected 
for  evaluation  is  the  same  as  that  done  by  Hull,  Speyer, 
Tseng,  and  Larson  [63]  so  that  a  comparison  can  be  made. 
The  performance  of  this  system  is  compared  to  that  of 
the  standard  linear  quadratic  Gaussian  (LQG)  guidance 
law  by  using  the  Lyapunov  function  from  Section  III. 

The  parameter  uncertainty  analysis  is  conducted 
in  Section  6.2.  The  analysis  is  conducted  for  the 
linear,  time- invar iant  scalar  problem  (  Section  6.2.1  ), 
the  linear,  time- invar iant  multivariable  control  problem 
(  Section  6.2.2  ),  the  linear,  time-varying  guidance 

problem  (  Section  6.3  ;,  the  naming  missile  guidance 

problem  with  angle  only  measurements  (  Section  6.4  ), 
and  the  homing  missile  observer  performance  improvements 
through  the  LQG  guidance  algorithm  (  Section  6.4.3  ). 


6.2.1  Linear,  Time- I nvar lant  Scalar  Problem 


Pc(t)  =  -2acpc(t)  +  r  c  1  c  ( t)  -  q,  (o.l0) 


PQ(t)  =  2a  =  pQ(t)  "  rokc(t)  +  qo  (6.11) 


where  a,  b,  h,  and  m  are  the  unknown  true  system  parame¬ 
ters,  and  ac  ,bc  »hc  '  mc'  »  1„  are  the  designed  (  or 
nominal  )  system  parameters.  p^  is  the  control  Riccati 

term  and  p  is  the  observer  covariance  term, 
o 

Following  the  same  procedure  as  in  Section 
4.2.1,  the  closed-loop  system  dynamics  can  be  rewritten 
to  emphasize  the  modelling  errors  in  the  following  way. 


x  <bclc(t).db(t>) 

d(t)  <ac-kclt,hc+abmlt" 


where  aab  ( t)  ,  d^  !  t)  ,  d  ( t)  ,  and  d&m  ( t)  are  defined  in 
equations  (4.14),  (4.15),  (4.18),  and  (4.19),  respec¬ 

tively.  Considering  steady-state  only,  p_;t'  and  r_  t- 
can  be  set  to  zero  in  equations  (6. IB)  and  (5.11)  suc.n 


Vc  -  qc 


(6.13) 


rokc  -  go 


(6.14) 
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6.2. 1.2  Steady-State  Eigenvalue  and  Lyapunov  Function 


Analysis 


The  purpose  of  this  effort  is  to  determine 
acceptable  ranges  of  modelling  errors  in  a,  b,  h,  and  m 
(i.e.  Aa  ,  ,  and  ZUt  which  are  defined  in  equations 

(4.9)  to  (4.12))  for  which  the  system  (equation  6.12) 
remains  stable.  One  way  is  to  look  at  the  eigenvalues 
of  the  system  matrix,  a,  for  various  modelling  errors 
where 


‘(a  -b„l 

_  u  ^ 

d 


-bcVdab> 


(bc1c+db> 
(a„-k„h  +d,  ) 

^  C  Dili 


(6.15) 


Note  that  if  there  were  no  modelling  errors,  the  stabil¬ 
ity  of  the  closed  loop  system  (  equation  6.12  )  is 

determined  by  the  eigenvalues  of  the  closed  loop  system 


m a  t  r ix 


•  b  1  _ ) 


;nd  the  observer  svstem  matrix 


(=„-K„ro  ,  separately  [122] 


ne  modelling  errors  wer 


varied  independently,  until  the  real  parts  of  the  eigen¬ 
values  of  a  in  equation  (6.15)  became  positive.  Tnis 
would  identify  a  bound  (or  range  of  values)  for  which 
the  system  would  remain  stable. 

This  same  approach  is  applied  to  the  Lyapunov 
functions  derived  in  Sections  III  and  IV.  Tne  Lyapunov 
function  in  Section  III,  which  is  the  Lyapunov  function 
for  tne  continuous,  linear,  time-varying  system  without 
parameter  uncertainties  is  presented  in  equations 


7T7 


1  ]  3 


(4.1)  —  (4.5)  .  When  parameter  uncertainties  are  intro¬ 
duced  in  the  system  model,  the  Lyapunov  function  remains 
positive  definite.  However,  the  sufficient  condition 
for  v  to  be  negative  semidefinite  is  provided  in  the 
inequality  constraint  of  equation  (4.22).  Considering 
the  steady-state  scalar  problem,  the  equation  becomes 


2 
c 

-r  r 


r„l„+a, 

2 


-r  r 


r„i;+q. 


2dabpc 

dP0  +  dbpc 


dD^+i  d  * 
o  b*  c 

2  d ,  p 
bm  o 


<0  (6.16) 


For  the  system  to  remain  stable  in  the  sense  of 
Lyapunov,  the  eigenvalues  of  the  left  side  of  equation 
(6.16)  must  be  negative. 

For  the  Lyapunov  function  derived  with  parameter 
uncertainties  (eqn.  (4.38)),  the  conditions  for  stabil¬ 
ity  are  different  then  equation  (6.16).  For  this 
Lyapunov  function,  V  is  negative  semidefinite  for  any 
uncertainty.  However,  the  sufficient  condition  for  V  to 
be  positive  definite  is  provided  in  the  inequality  con¬ 
straint  of  equation  (4. 40).  Considering  the  steady- 
state  scalar  problem,  the  equation  oecomes 


>  0 


(6.18) 


where 


Ac  Aslruc'bc1c+dao)  'VA' 
A„  L  d  (ac-K  =  hct3b>nl 


Wc^.b’*  dT  Ac  Ai 

(bc1c’fdb)T  'V‘A-W  A*  Ap 


r  2  2i 

-r  lz 

+  "  "c  =0 
.  'rc1c  VH 


(6.19) 


which  is  an  algebraic  Lyapunov  equation.  For  the  system 
to  remain  stable  in  the  sense  of  Lyapunov,  the  eigen¬ 
values  of  the  left  side  of  equation  (6.18)  must  be 
positive. 

For  the  eigenvalue  analysis  and  the  two  Lyapunov 
functions,  the  system  parameters  were  chosen  as  [122] 


_  i  r  =  i 

~  ~  -  t 


q„  =  1  ,  r  -  1  ,  q  =  1  (6.20) 

w  o  o 


For  all  three  cases,  the  system  modelling  errors 
(Aa ,  At,  At,  and  were  varied  independently  until  the 

stability  conditions  were  violated.  The  results  are 
shown  in  Table  6.1.  By  comparing  the  results  of  the 
Lyapunov  equations  to  the  eigenvalue  analysis  (which  is 
known  to  be  valid)  ,  a  measure  of  the  effectiveness  of 
each  Lyapunov  function  to  identify  regions  of  stability 
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Ma  tr i x 

T  i  r\  envs  I  e? 

i-.'/o  Parameter 
Uncertainties 

w/  Parameter 
Uncertainties 

.^a<  .  3? 

-8.75  <_^a  <  .  1 

_p  <  .  3  9 

A b  >  -  .  3 

-. 2<A^<  •  2 

Ab> - .  3 

- . i <Ah  <2.1 

/  VI  '  -  .  J 

Am  <.07 

025  <  Air.  <.02  5 

Am  <.07 

TABLE  6.1  Acceptable  Ranoes  of  Parameter  Uncertainties 

for  Scalar  Problem 


can  be  obtained.  Note  that  the  Lyapunov  function 
derived  without  parameter  uncertainties  has  both  upper 
and  lower  bounds  on  the  acceptable  ranges  of  parameter 
uncertainties.  T.nis  is  oecause  of  tne  quadratic  nature 
of  the  inequality  constraint  (equation  6.16).  The 
bounds  tended  to  be  a  little  tighter  then  that  of  the 
system  eigenvalue  analysis.  The  bounds  on  the  Lyapunov 
function  derived  with  parameter  uncertainties  are 
equivalent  to  those  of  the  system  eigenvalue  analysis. 
These  bounds  are  very  similiar  to  those  found  by  Speyer 
[122]  . 

The  Lyapunov  function  from  Section  II,  wnich 


consisted  of  combining  the  separate 


controller 


ana 


observer  Lyapunov  functions,  is  also  evaluated  under 

parameter  variations,  and  was  found  to  be  an  invalid 
Lyapunov  function  given  the  system  parameters  in  equa¬ 
tion  (6.20),  even  without  any  parameter  variations.  In 
Section  II,  it  was  pointed  out  that  this  particular 

function  (  equation  (2.67)  )  can  not  be  analytically 

shown  to  be  a  valid  Lyapunov  function  for  the  closed- 

loop  system  with  an  observer  in  the  loop.  The  numerical 
results  have  reinforced  these  analytic  statements  and 
have  demonstrated  that  equation  (2.67)  is  not  a  valid 
Lyapunov  function  for  all  choices  of  system  parameters. 


6.2.2  Linear,  Time-Invariant  Multivariable  Control  Prob- 
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E  [ui(  t)  iuT  (t)  ]  =  6  ( t  -  tr) 
E  [  (/( t)  tuT  (r)  ]  =  0 
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-  [50 


10] 


x 
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1 

2. 


x  =  ( A-BL) x  +  K [y-Hx] 


-P„A  -  ATP  +  LTR  L  +  Q 
c  c  c  c 

AP0  +  P0AT  -  KRoKT  +  O0 

K  =  P  HTR~1 
0  o 
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(6.24) 

(6.25) 

(6.26) 

(6.27) 

(6.28) 

(6.29) 

(6.30) 


R_  =  1 

2800  473.291 

473.29  80  J 

Ro  *  1 


n  [  1225  -21  35' 

“o  [-2135  3721  j 

I  *  4,°  i] 

(6.34) 

Tnis  system  represents 

a  weakly  stable 

system  , 

(6.31) 

(6.32) 

(6.33) 
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k  i.«  -jyL  4^4  , 


where  weakly  implies  the  system  has  poor  phase  margin 

[41].  Doyle  and  Stein  set  out  to  increase  the  stability 

(  or  robustness  )  of  the  system  by  adding  a  constant 

2 

fictitious  term,  q  ,  to  the  process  noise  covariance 
matrix,  Qq  .  By  using  Nyquist  diagrams,  Doyle  and  Stein 
were  able  to  come  up  with  a  reasonable  compromise 

between  noise  performance  and  robustness  by  increasing 

2  2 
q  [41].  By  increasing  q  ,  the  error  covariance 

increases  and  the  closed  loop  stability  margins  improve. 


6. 2. 2.1  Steady-State  Eigenvalue  and  Lyapunov  Function 


Analvs is 


As  in  the  scalar  case  in  Section  6. 2.1.2, 
steady-state  analysis  is  applied  to  the  closed  loop  sys¬ 
tem  and  the  two  Lyapunov  functions.  For  this  example,  a 
variation  in  the  control  matrix,  B,  is  investigated  ( 

i.e.  A£  ) .  Acceptable  ranges  of  variations  were  gen- 
2 

erated  for  q  set  to  0,  100,  1000,  and  10000,  which  were 
the  same  values  selected  by  Doyle  and  Stein. 

For  the  eigenvalue  analysis,  the  closed  loop 
system  matrix  is 


A„-B„L„+D, 


BcLc+DB 

Ac~KcHc+DB 


(6.35) 


where  D^g ,  Dg  and  D  come  from  equations  (4.14),  (4.15), 
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and  (4.18),  respectively.  The  inequality  constraint 
that  validates  the  Lyapunov  function  derived  without 
parameter  variations  is  equation  (4.26)  and  the  inequal¬ 
ity  constraint  that  validates  the  Lyapunov  function 
derived  with  parameter  variations  is  equation  (4.40). 
The  results  are  shown  in  Table  6.2. 


System 

Matrix 

Eigenvalues 


Ap>-.2 


Ab  >-.25 


'  \.E  >-.65 


Lyapunov  Function  !  Lyapunov  Function 


0000  I  A?. >-1.05 


w/c  Parameter 
Uncertainties 


-.0025<A3< . 0025 


-. 0045 <^S< . 0045 


,  0 1 5  5  <  •'■•£<.  0 1 7 


-. 0285<AB< .0275 


w/  Pr.r3.nets r 
Uncertaint.es 


A£>- . 


/\B  >-.25 


/\2  >  - 


As >-1.05 


TABLE  6.2  Acceptable  Ranges  of  Parameter  Uncertaint ie: 
for  Multivariable  Problem. 


The  Lyapunov  function  derived  without  parameter 
uncertainties  has  both  upper  and  lower  bounds  on  AB/  as 
in  the  scalar  case.  These  bounds  are  much  narrower  than 
in  the  scalar  problem.  The  bounds  on  Ap  produced  by  the 
Lyapunov  function  which  includes  parameter  uncertainties 
are  identical  to  those  of  the  system  eigenvalue 
analysis.  As  in  the  paper  by  Doyle  and  Stein  [41],  the 
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system  stability  margins  increased  as  q  is  increased  in 
both  Lyapunov  function  analysis.  The  Lyapunov  function, 
which  consisted  of  combining  the  separate  controller  and 
observer  Lyapunov  functions,  was  also  evaluated  under 
variations  of  A3r  and  was  found  to  be  an  invalid 


Lyapunov  function  given  the  system  parameters  defined  in 


derived  with  parameter  uncertainties  is  very  accurate  in 
identifying  acceptable  ranges  of  A3  variations  for  sys¬ 
tem  stability  through  steady-state  analysis.  In  this 
section,  the  actual  time  response  of  the  Lyapunov  equa¬ 
tion  (4.80'  for  the  Lyapunov  function  derived  with 
parameter  uncertainties  is  investigated. 


Figures  6.1  to  6.4  snow  the  minimum  eigenvalue 

2 

of  the  Lyapunov  equation  for  q  =0,  100,  1000,  and  10000. 

2 

For  each  value  of  q  ,  several  values  of  A3  are  con¬ 
sidered.  The  figures  do  not  show  any  significant 
changes  to  the  minimum  eigenvalues.  The  figures  do  show 
that  the  solution  to  the  Lyapunov  equation  is  positive 
definite  for  K>0. 
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5  Figures  6.5  to  6.8  show  the  maximum  eigenvalue 

Ij  of  the  Lyapunov  equation  for  the  same  values  of  q^  and 

|  A3.  When  A3  exceeds  the  acceptable  ranges  identified  in 
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jj  unbounded  with  very  large  negative  slopes.  With  the 

3  system  going  unstable  and  the  states  diverging,  the 
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fj  Lyapunov  equation  becomes  unbounded  from  above.  Since 

■  j  the  steady-state  analysis  is  meaningless  for  the  time- 
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Figures  6.5  to  6.8  show  the  maximum  eigenvalue 

2 

of  the  Lyapunov  equation  for  the  same  values  of  q  and 
A3.  When  A3  exceeds  the  acceptable  ranges  identified  in 
the  previous  section,  the  maximum  eigenvalue  becomes 
unbounded  with  very  large  negative  slopes.  With  the 
system  going  unstable  and  the  states  diverging,  the 
Lyapunov  equation  becomes  unbounded  from  above.  Since 
the  steady-state  analysis  is  meaningless  for  the  time- 
varying  problem,  this  type  of  analysis  is  more  appropri¬ 
ate  . 


3  Robustness  Improvements  Through  Lyapunov 


For  this  linear  problem,  Doyle  and  Stein 
improved  the  robustness  characteristics  (  or  stability 
margin  )  by  adding  a  "fictitious  noise"  term  to  the  pro¬ 
cess  noise  covariance  matrix  [41].  A  more  systematic 
way  to  improve  stability  margins  might  be  available  by 
taking  a  closer  look  at  the  Lyapunov  function  which  con¬ 
sists  of  combining  the  separate  controller  and  observer 
Lyapunov  functions  (equation  2.67). 

From  Section  II,  the  condition  necessary  for 
this  function  to  be  a  valid  Lyapunov  function  is  that 


-L~RL-Q„ 
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(6.36) 


This  may  not  always  oe  true  (  and  in  the  cases,  so  far, 
it  has  not  been  true  )  ;  however,  R,  ,  R  ,  and  Qq  can 
be  choosen  to  ensure  that  the  inequality  constraint  is 
valid.  Doyle  and  Stein's  approach  involved  increasing 
Qq ,  which  would  improve  the  negative  definiteness  of  the 
left  side  of  equation  (6.36).  Anotner  way  might  be  to 
decrease  .  Tnis  implies  that,  given  the  controller, 
the  measurement  device  has  to  have  a  certain  accuracy  tc 
ensure  the  system  remains  stable.  A  third  way  would  be 
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to  decrease  Qc  in  the  control  design.  Tnis  has  the 
effect  of  decreasing  the  control  gain,  L.  Although  this 
can  make  the  system  more  robust,  it  has  the  adverse 
effect  of  reducing  the  response  of  the  closed  loop  sys¬ 
tem.  There  is  a  tradeoff  to  be  made  between  system 
response  time  and  robustness  to  system  modelling  errors. 

For  this  study,  was  changed  to  Qc  by  the  fol¬ 
lowing  : 

Qc  =  <XQC  (6.37) 

where 

c(  =  .  001  (6.38) 

This  changed  the  control  gain  to 

L  =  [  .  4  2  5  .116  ]  (6.39,' 

and  satisfied  the  inequality  constraint,  equation 
(6.42)  . 

The  closed  loop  simulation  was  run  using  this 
2 

new  control  gain  for  q  =0  and  Aj3  =  0,  -.25,  and  -.75. 
Only  q"  =  0  was  used  since  it  demonstrated  the  least 

system  rooustness  properties.  Figures  6.9,  6.10,  and 

6.1 1  represent  the  system  by  Doyle  and  Stein  using  the 

Figures  6.12,  6.13, 


control  gain  from  equation  (6.26). 


the  control  gain,  L,  (equation  6.39).  The  results  on 
the  last  three  figures  show  that  the  system  is  much  more 
robust  then  the  results  using  the  original  control  gain; 
although  the  system  is  somewhat  less  responsive. 

Thus,  this  Lyapunov  function  provides  a  means 
for  making  the  controller/observer  system  more  stable 
(or  robust)  through  an  overall  design  selection  of  the 
fa  controller  and  observer  parameters. 
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6.3  Linear,  Time-Varying  Guidance  Problem 


The  system  selected  for  this  analysis  is 


x  =  Ax  +  B  u  ( t )  +ui,  x  ( t 


(6.40) 


where  x  is  a  6-state  vector  of  the  2-dimensional  com¬ 
ponents  of  relative  position,  velocity,  and  target 
acceleration,  and  u  is  the  2-dimensional  missile 
acceleration .  In  addition. 


(6.41) 


u  ;  t )  =  - 1  ?  t )  x 


'6.42) 


(6.43 


X  =  ( A-BL ( t) ) x  +  K[v-Hx]  ,  x ( t  )  =  x  (6.44) 

o  o 


y  =  H  x  +  (/ 


H  =  [  I  0  c  ] 


ui  -  n  (0 ,  q  ■>  ,  (/  _  s  (e  ,r  ;■ 


6.45) 


(6.46) 


(6.47) 


where  ^  is  the  target  acceleration  response  time  coef¬ 
ficient  and  I  is  a  2x2  identity  matrix.  The  initial 
conditions  for  the  closed  loop  system  are 


x  =  [  3  508  ,  1500  ,  -1100  ,  -1  50  ,  10  ,  10  ]  ‘  (6.58) 

O 


xq  =  [  3000  ,  1200  ,  -950  ,  -100  ,0,0]  (6.51) 


6.3.1  Time-Varvina  Guidance  L 
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from  linear  quadratic  Gaussian  theory,  and  is  derived 
fro-  tr.  e  folio  wine  ocorn  rzaoior.  crocla-  '18  S' 


1  .  X  ,  r  X  . 
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subject  to  equation  (6.40),  where 


G*  =  £ 

.£ 


C-*  =  B  0  0 

[800  6x6 


*  -  [: 


This  cost  functional  is  constructed  to  minimize 
final  miss  distance  with  no  weighting  on  final  relative 
velocity  nor  target  acceleration,  and  a  weighted  cost  on 


the  control 


missile  acceleration 


through  the 


integral  term  [109].  The  weighting  factor,  b,  deter¬ 
mines  the  degree  of  cost  of  control  versus  cost  of  ter¬ 
minal  miss  distance.  A  small  value  of  b  implies  more 
emphasis  is  placed  on  minimizing  terminal  miss  distance 
at  the  cost  of  control  effort. 

An  important  point  to  make  is  that  the  optimiza¬ 
tion  problem  is  based  on  the  assumption  that  the  control 


:or,  u,  is  the  missile's  acceleration 


?nis  lmolies 


that  the  missile  has  instantaneous  response  and  complete 
control  over  all  inertial  acceleration  components. 

T.ne  octix  ization  orobierr  generates  a  linear, 
closed-form  control  .aw  of  the  form  [109] 


u[t)  =  - 


3  s  n;  -  [  I  tal  KtI  ]x(t) 


(6.55) 


=  +-  _ 


(6.56 


In  practice,  the  control  law,  u(t) ,  is  a  func¬ 
tion  of  the  estimated  states,  x(t)  ,  and  not  the  true 
states,  x(t) ,  which  are  typically  unknown.  This  is  jus¬ 
tified  through  the  separation  principle. 


6.3.2  Time-To-Go  Error  Analysis 


Note  that  the  control  law,  equation  (6.55)  ,  is 
an  explicit  function  of  tQ .  The  theory  that  is  used  to 
obtain  the  solution  assumed  that  the  final  time,  t^,  is 
specified;  therefore,  to  insure  optimality,  must  be 

known  apriori  or  at  least  accurately  estimated  during 
flight  [109]  .  Since  t*  cannot  oe  realistically  known 

x. 

apriori  (  especially  for  a  maneuvering  target  )  ,  tf  (or 
t^'  must  be  estimated.  Studies  have  s.nown  that  the 
accuracy  of  t  can  drastically  affect  the  performance  of 


:  n  e  z  o  n  t : 


i  “  f  ^  ^  *  HO*-.  6  .  f  .  i  h  —  —  —  ■ 


have  on  tne  oerformance  of  the  svstem? 


To  analvze  tne  effects  of  errors  in 


on  tne 


performance  of  the  closed  loop  system,  consider  model¬ 
ling  t  as  the  followinc 
9 


=  S  t„  +  b 


(6.58: 


wnere  2  is  a  scale  factor  error,  E  is  a  bias  error  and 
t  ^  is  tne  true  time-to-go,  whicr.  comes  from,  equation 
(6.56,'  ,  wnere  t*  is  set  to  4  seconds.  Scale  factor 


errors  are  selected  as  1.5,  1.0,  and  0.5.  Trie  effects 

of  these  errors  are  evaluated  separately  from  the  Dias 
errors,  which  are  selected  as  -0.2,  0,  and  0.2. 

Using  equation  (6.58)  in  the  control  law,  a 
simulation  of  the  system  defined  in  Section  6.3  was  run 
for  the  various  scale  factor  and  bias  errors 
(5  =  1  and  (B  =  0  implies  zero  errors  )  .  The  simulation 
is  used  to  evaluate  the  three  Lyapunov  functions  derived 
earlier:  The  Lyapunov  function  which  is  the  combination 

of  the  separate  controller  and  ooserver  Lyapunov  func¬ 
tions,  the  Lyapunov  function  derived  without  parameter 
uncertainties,  and  the  Lyapunov  function  derived  with 
parameter  uncertainties.  For  tne  different  values  of 
scale  factor  error  and  bias  error  ,  the  three  Lyapunov 
functions  are  checked  to  determine  if  they  remain  a 
valid  Lyapunov  function.  The  combined  Lyapunov  function 
is  cos:t:-e  definite  for  all  x  ,e  =  2  and  all  scale  fer- 


:or  anc  cias  errors. 


rendition  for  tne  slooe  of  tne 


.vaounov  function  to  oe  negative  serr.ioef mite  is 


A 


of  tne  maximum  eigenvalue  of  equation  (6.59)  for  tne 
combined  Lyapunov  function,  given  no  scale  factor  or 


bias  errors.  Since  this  shows  equation  (6.59)  is  not 
negative  semidefinite  even  for  the  error-free  case,  the 
combined  Lyapunov  function  is  not  a  good  measure  of  per¬ 
formance  for  the  system  considered.  The  result  is  simi- 
liar  to  the  results  found  in  the  steady-state  analysis. 

The  maximum  eigenvalue  for  equation  (4.65)  starts  at 

_  1  o 

zero  for  t=tf  and  remains  approximately  -10  for 

0  £  t  <  t^  and  for  all  values  of  scale  factor  and  bias 
errors.  This  indicates  that  the  Lyapunov  function 
derived  without  parameter  uncertainties  is  valid  for  all 
time-to-go  errors.  Figures  6.16  and  6.17  are  plots  of 
the  minimum  eigenvalue  of  the  Lyapunov  equation  (equa¬ 
tion  (4.32))  for  the  Lyapunov  function  derived  with 
parameter  uncertainties,  given  scale  factor  and  Dias 
errors.  Tne  eigenvalues  remained  positive  for 
C  £  t  <  tf,  indicating  that  this  Lyapunov  function  is 
valid  for  all  time-to-go  errors.  Figures  6. IS  and  6.19 
snow  the  maximum  eigenvalue  of  the  same  Lyapunov  equa¬ 
tion,  given  scale  factor  and  bias  errors.  These  eigen¬ 
values  remain  bounded  for  all  values  of  scale  factor  and 
bias  errors  . 


The  results  of  the  last  two  Lyapunov  functions 
indicate  that  errors  in  time-to-go  do  not  degrade  the 
performance  of  the  system  for  0  <  t  <t£.  Fiaures  6.20- 
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Figure  6.21,  Velocity  For  Bias  Error 
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Figure  6.22,  Taroet  Acceleration  For  Bias  Error 
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Fiaure  6.24 


Velocity  Error  For  Eias  Error 
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Figure  6.27,  Velocity  For  Scale  Factor  Error 
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Figure  6.29,  Range  Error  For  Scale  Factor  Error 


6.3.3  Taraet  Acceleration  Modellina  Errors 


System  parameter  uncertainties  and  tneir  effect- 
on  system  stability  are  discussed  in  Section  IV.  Since 
tne  emphasis  is  on  finite  time  problems,  tne  Lyapunov 
function  derived  without  parameter  uncertainties  (equa¬ 
tion  (4.21))  and  the  Lyapunov  function  derived  with 
parameter  uncertainties  (equation  (4.37))  are  used  to 
provide  a  measure  of  system  performance  given  parameter 
uncertainties.  Tnis  section  focuses  on  errors  in  the 
system  matrix,  A;  in  particular,  errors  in  the  target 
acceleration  time  constant,  ^  As  in  the  steady-state 

analysis  of  Sections  6.2. 1.2  and  6. 2. 2.1,  the  first 
Lyapunov  function  is  valid  under  a  very  narrow  region 


around  tne  true  value  o: 


Tne  Lvaounov  function 


derived  with  parameter  variations  is  valid  for  a  range 


Consider  tne  designed  system  matrix  to  oe  oe- 
fined,  as  in  Section  IV,  in  the  following  way 


A  =  A  - 


(6.61) 


where  a^a  is  the  modelling  error  and  involves  errors  in 
^  only.  Using  the  same  system  defined  in  Section  6.3, 


simulation  runs  were  ten; 


tne  follow  mo 


=  *“  Ci  **■ 


/  V  V  V  V 'm*  V*  “/  V  V  V  V ' 


K, 

I 


AA  =  0  0  0 

0  0 


(6.60) 


where  AA  =  0/  1/  2,  and  3. 

For  these  values  of  /^A,  the  Lyapunov  function 
without  parameter  uncertainties  and  the  Lyapunov  func¬ 
tion  with  parameter  uncertainties  are  evaluated  the  same 
way  as  in  the  time-to-gc  error  analysis.  The  combined 
Lyapunov  function  will  not  be  used  for  any  further 
analysis  since  the  same  system  is  used,  and  it  is  shown 
that  this  Lyapunov  function  has  a  positive  slope  for 
zero  parameter  errors. 


Figure  6.32  is  a  plot  of  the  maximum  eigenvalue 

of  equation  (4.65)  for  the  Lyapunov  function  derived 

without  parameter  uncertainties.  For  £j\=Q  ,  the  eigen- 

-12 

value  is  approximately  -10  for  0_<t<t^.  This  small  a 
number  cannot  be  seen  on  the  figure.  For  Ak=10  7  ,  the 
maximum  eigenvalue  becomes  positive,  thus  invalidating 
this  Lyapunov  function.  Figure  6.33  shows  the  minimum 
eigenvalue  of  equation  (4.82)  for  the  Lyapunov  equation 
derived  with  parameter  uncertainties.  Figures  6.34  and 
6.35  show  the  maximum  eigenvalue  for  the  same  Lyapunov 
equation.  This  Lyapunov  equation  indicates  good  perfor¬ 
mance  for  t!^=0  and  1;  however,  the  function  becomes 


36 


unbounded  from  above  for  =2  and  3.  Thus,  for  _1^>2, 


this  Lyapunov  equation  indicates  that  the  system  will 


m\ 


WWW 


not  perform  well  for  all  x  and  e. 


Figures  6.36-6.43  are  plots  of  the  magnitude  of 
relative  position,  velocity,  and  target  acceleration;  as 
well  as  their  errors  from  the  estimation  algorithm  for 
the  set  of  launch  conditions  specified  in  Section  6.3. 
These  results  are  useful  in  showing  that  the  Lyapunov 
function  without  parameter  uncertainties  is  a  poor  meas¬ 
ure  of  performance  for  this  system  with  target  accelera¬ 
tion  modelling  errors. 
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Missile  Guidance  Problem 


Ang  1  e 


Measurements 


The  system  selected  for  this  analysis  is  identi¬ 
cal  to  the  one  defined  in  Section  6.3,  except  that  the 
measurement  model  is  a  nonlinear  function  of  the  system 
states  representing  an  angular  measurement  from  the  fol¬ 
lowing  figure. 

I 


I 

Figure  6.44,  Angular  Measurement  Related  to 
System  States 


The  measurement  model  now  becomes 


y  =  h  (x)  +  {/  ,  (/  _  N  (B ,  R  (6.62) 

o 


wnere  R 


.  1  and 


The  estimation  algorithm  can  no  longer  be  a  linear  Kal¬ 
man  observer,  as  in  Section  6.3,  since  the  measurement 
model  is  nonlinear. 

6.4.1  Pseudomeasurement  Observer 

The  pseudomeasurement  observer  (PMO)  is  selected 
as  the  estimation  algorithm  because  it  is  reasonably 
easy  to  mechanize  (  like  the  extended  Kalman  observer  ) 
and  it  has  global  convergence  properties  [119,120].  The 
algorithm  for  the  PMC  is  [119,120] 

x  =  Ax  +  Su  +  X (y  -n ( x)  )  ,  x(t^)  =  x^  (6.64) 

where 


k  =  pg  (y*  ,x)  R"1 

w 


(6.65) 


p  =  Ap  +  daT  +  Qo  -  pnT  (x)  R“:h  (x)  p 


“  pgTR„^n  (x)  p  +  ohT (x)  R  ^h  ( x)  d 
o  o 


6.66) 


y  =  h ( X }  (6.67) 


Tne  definition  for  modifiable 


[119,120]  is  tnat 
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a  time- 

varying 

function  h:  Rn->R^  is  a 

mod  if iable 

non- 

1  inear 

system 

function  if  there  exists 

a  p  x  n 

time- 

varying 

matrix 

of  functions  g:  R^  x  Rn 

->  RPxn  so 

tha  t 

for  any 

x  ,  3c  < 

Rn  and  y  <  R^ , 

h(x)  -  h { x )  =  g(y*,x)(x  -  x)  (6.68) 


and 


n ( x)  -  n(x)  =  g  ( y*  ,  x )  ( x  -  x)  (6.69) 

6.4.2  Target  Acceleration  Modelling  Errors 

The  target  acceleration  modelling  error  analysis 
follows  the  same  work  discussed  in  Section  6.3.3,  where 
the  target  acceleration  modelling  error  comes  from  equa¬ 
tions  (6.60)  and  (6.61)  ,  and  where  Aa  is  selected  as  3, 
1 ,  2 ,  and  3  . 

For  these  values  of  ,  both  the  Lyapunov  func¬ 
tion  without  parameter  uncertainties  and  tne  Lyapunov 
function  with  parameter  uncertainties  are  evaluated 
using  the  PMO  algorithm  and  the  initial  conditions  from 
Section  6.3  and  6.4.  Figure  6.45  is  the  maximum  eigen¬ 
value  of  equation  f  4 .65)  for  the  Lyapunov  function 
derived  without  parameter  uncertainties.  Tne  results 
indicate  that  for  very  small  ( /J=  I  P~  )  ,  the  maximum 

eigenvalue  oecomes  oositive,  thus  invalidating  tr.is 
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Lyapunov  function.  Figures  6.46  and  6.47  show  the 
minimum  eigenvalue  of  equation  (4.82)  for  the  Lyapunov 
function  with  parameter  uncer ta inties .  Figures  6.48  and 
6.49  show  the  maximum  eigenvalue  for  the  same  Lyapunov 
equation.  This  Lyapunov  equation  shows  that  the  system 
performs  well  for  Aa=0  and  1.  For  /yi=2  and  3,  the 
Lyapunov  function  indicates  that  the  system  will  not 
perform  well  for  all  x  and  e. 

Figures  6.50-6.57  are  plots  of  tne  magnitude  of 
relative  position,  velocity,  and  target  acceleration; 
as  well  as  their  errors  from  the  PMO  for  the  set  of 
launch  conditions  specified  in  Section  5.2.  Again, 
these  results  are  useful  in  showing  that  the  Lyapunov 
function  derived  without  parameter  uncertainties  is  a 
poor  measure  of  performance  for  mis  system  witn  target 
acceleration  modellinc  errors. 
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6.4.3  Observer  Performance  Improvements 


The  purpose  of  this  section  is  to  demonstrate 
the  usefulness  of  the  LQG  guidance  law,  derived  tc 
minimize  terminal  miss  distance  as  well  maximize  the  oo- 
servability  Grammian  matrix  of  the  P^O  (  equation  5.22- 


5.25 


To  simplify  the  analysis,  a  2-dimensional  sys¬ 


tem  model  is  used.  For  a  2-dimensional  system,  the 
measurement  model  comes  from  equations  (6.62)  and 
(6.63).  For  the  PSO,  the  measurement  model  is 


y  =  H  ( z )  x 


(6.79) 


where 


LT  '  *7  '  —  ’  cc 

\  Z  ,»  —  j  i- 


n  ^  r  —  c  o  s  0  f  v  t  xj  f  3  f  C  j 


Following  the  sate  stets  i : 


1  ra  \  ^  ~ 


T  *  ^  -  v  V  'I' 


_  ^ 

2b  "I 


0  0 
0  0 


(6.81) 


which  is  a  6x6  matrix 


Given  the  following  intercept  geometry 


Figure  5.58,  Intercept  Geometry 


the  following  initial  launch  conditions  are  selected  to 
closely  mater,  those  by  Hull,  Speyer,  Tseng,  and  Larson 
[531:  initial  range  of  3000  ft.,  missile  velocity  of 

3  S  3  ft.'sec.,  tercet  v  e  1  o  c  i  t  v  of  30  3  ft.-'sec.,  tarcet 
direction  of  =  30  deg.,  and  zero  target  acceleration. 

Figures  (6.59)  and  (6.63)  snow  the  results  of 
using  pro-nav  guidance  and  the  LQG  guidance  law  (  equa¬ 
tion  6.55  ),  respectively.  In  both  cases,  the  main  goal 
is  to  hit  the  target. 

To  solve  the  LQG  guidance  law  which  increases 
the  PMO’s  observability  Grammian  matrix  (  equations 
5.11-5.12  ),  the  differential  equations  (equations 

5.22-5.25)  have  to  oe  solved  backward  in  time  from  tf  to 


t_.  Tns  first  step  is  to  use  the  following  approxima- 

'o 

tion  for  t ^ ,  since  it  is  not  readily  available. 

=  -  ~  (6.82) 
R 

With  this  t^,  the  guidance  law  is  solved  and  implemented 
in  the  simulation,  where  the  results  are  on  Figure 
(6.61)  for  d,  =  .  667.  The  missile  swings  past  the  line- 
of-sight  to  the  target  and  then  comes  back.  This  is 
similiar  to  the  results  of  Hull,  Speyer,  Tseng,  and  Lar¬ 
son  [63],  except  that  the  missile  overshoots  the  target 
at  the  end.  This  is  because  is  an  approximation 

(equation  6.73)  and  is  only  solved  once. 

The  next  step  is  to  update  tf  periodically,  as 
is  done  in  the  LQG  guidance  law,  and  resolve  the  new 
guidance  law  each  time.  The  new  results,  shown  in  Fig¬ 
ure  (6.62),  snow  a  similar  trajectory  with  the  exception 
t.nat  tne  missile  hits  the  target. 

Increasing  the  PMO's  observaoil ity  Grammian 
means  decreasing  the  PMO's  error  variance.  To  show  if 
this  new  guidance  law  decreases  the  PMO's  error  variance 
matrix  (equation  5.11),  a  time-plot  is  generated  of  the 
maximum  eigenvalue  of  the  error  variance  matrix  of  the 
PMO ,  with  both  the  standard  LQG  guidance  law  and  the  new 
LQG  guidance  law.  Tne  results,  (Figure  (6.63))  ,  show 
that  the  error  variance  is  reduced  by  the  new  LQG  gui- 


dance  law,  as  would  be  expected.  The  minimum  eigenvalue 
shows  the  same  trend. 

In  addition,  the  minimum  and  maximum  eigenvalues 
of  equation  (4.65)  for  the  Lyapunov  function  derived 
without  parameter  uncertainties  are  generated  for  the 
new  guidance  law  using  the  PMO  and  the  LQG  guidance  law 
using  the  same  observer.  Figure  6.64  shows  that  the 
minimum  eigenvalue  of  the  Lyapunov  equation  for  the  new 
guidance  law  has  a  slightly  larger  negative  slope  and 
more  positive  value,  but  still  remains  bounded.  The 
increased  slope  is  due  to  the  fact  that  the  system  ini¬ 
tially  diverges  to  improve  observability.  Figure  6.65 
shows  the  same  trend  for  the  maximum  eigenvalue. 

The  results  show  that  the  guidance  law  causes 
the  missile  to  maneuver  in  such  a  way  as  to  improve  the 
observability  of  the  nonlinear  measurements  with  a 
slight  deterioration  to  the  Lyapunov  funtion.  The  end 
result  is  a  guidance  law  that  still  hits  the  target,  and 
in  addition  improves  the  PMO's  performance  by  increasing 
its  observability  Grammian  matrix.  The  fact  that  the 
maximum  eigenvalue  of  the  Lyapunov  equation  has  a  larger 
slope  indicates  that  the  convergence  is  faster  than  that 
of  the  LQG  guidance  law.  The  larger  positive  value  in 
the  beginning  is  due  to  the  missile's  initial  deviation 


from  the  taraet. 
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Figure  6.61,  LQG  With  Error  Varian: 

Reduction  Guidance 
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SECTION  VII 


CONCLUSIONS 

Given  the  linear,  time-varying  closed-loop  sys¬ 
tem  with  an  observer  in  the  loop,  several  Lyapunov  func¬ 
tions  are  derived  for  the  first  time,  to  show  that  these 
systems  are  stable  in  the  sense  of  Lyapunov,  The 
Lyapunov  functions  are  used  to  provide  a  measure  of  per¬ 
formance,  independent  of  the  path  taken,  for  the  linear, 
finite-time  problem,  and  certain  classes  of  nonlinear, 
finite-time  problems  like  the  horn  in  a  missile  oroblem. 

The  Lyapunov  function  which  consists  of  adding 
the  controller  Lyapunov  function  by  Anderson  and  Moore 
[6]  to  the  observer  Lyapunov  function  oy  Song  and  Speyer 
[119,120]  is  not  valid  for  all  control ler /observer  sys¬ 
tems.  However,  tne  controller  performance  index  is 
scaled  such  that  the  combined  Lyapunov  functions  are 
valid  witnout  affecting  tne  control  gain.  Further,  this 
Lyapunov  function  is  used  as  a  means  of  improving  the 
stability  of  the  control ler/observer  system  through  an 
overall  design  selection  of  the  controller  and  observer 
parameters  to  meet  the  Lyapunov  function  requirements. 
This  is  demonstrated  in  Section  6. 2. 2. 3;  where  the  con¬ 
troller  gain  is  designed  based  on  the  combined  Lyapunov 
function. 


Since  the  combined  Lyapunov  function  is  not 
valid  for  all  control  ler  ./observer  systems,  a  Lyapunov 
function  is  derived  for  the  cascaded  system.  The  result 
is  a  Lyapunov  function  which  consists  of  the  separate 
controller  and  observer  Lyapunov  functions  and  an  addi¬ 
tional  term,  which  is  a  coupling  of  the  system  states 
and  the  observer  errors.  This  Lyapunov  function  is 
valid  for  all  control  1 er /observer  systems.  When  system 
parameter  uncertainties  are  introduced,  this  Lyapunov 
function  is  not  very  useful  for  identifying  system  sta¬ 
bility.  Tnis  is  shown  in  Sections  6.2.1,  6.2.2,  6.3.3, 
and  6.4.2. 


A  Lyapunov  function  is  derived  to  directly  ac¬ 
count  for  system  parameter  variations.  This  Lyapunov 
function  is  very  accurate  in  identifying  system  staoili- 
ty  of  the  linear,  time- invar iant  system  under  parameter 
variations  w.ne.n  compared  to  eigenvalue  analysis.  Tr.is 
Lyapunov  function  is  also  useful  in  providing  a  measure 
of  system  performance  for  the  linear,  time-varying, 
finite-time  problem  and  the  homing  missile  guidance 
problem.  The  results  of  this  are  in  Sections  6.2.1, 
6.2.2,  6.3.3,  and  6.4.2. 
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causes  tne  missile  to  maneuver  in  such  a  way  as  to  in¬ 
crease  the  ooservabil ity  Grammian  matrix  of  the  ooserver 
and  still  hit  the  target.  The  results  are  very  close  to 
those  by  Hull,  Speyer,  Tseng,  and  Larson  [63].  The 
Lyapunov  function  from  Section  III,  which  is  used  as  the 
basis  for  the  derivation  of  this  guidance  law,  shows  an 
improvement  in  performance  over  the  linear  quadratic 
Gaussian  guidance  law.  The  main  contribution  is  that  a 
closed-looD  solution  of  the  control  law  is  obtained. 


There  are  several  limitations  to  the  usefulness 
of  the  Lyapunov  functions  derived  for  the  linear,  time- 
varying  controller /observer  cascaded  system,  First,  they 
are  only  valid  for  the  deterministic  systems.  Second, 
thev  can  onlv  oe  used  to  determine  svstem  stabilitv  for 


inn  n  it  e -  time  orooi* 


Even  tnen ,  it  is  a 


ciency  condition  for  stability.  For  the  finite-time 
prooie.T, ,  tne  Lyapunov  functions  car.  only  provide  a  meas¬ 
ure  of  system  performance.  Third,  the  performance  meas¬ 
ure  is  determined  oy  solving  oackward  Lyapunov  equa¬ 
tions.  Tnis  requires  a  fairly  good  estimate  of  the  fi¬ 
nal  time  for  the  system  of  interest.  For  the  homing 
missile  guidance  problem,  an  estimate  of  final  time  is 
relatively  easy  to  obtain.  And  fourth,  Lyapunov  func¬ 
tions  are  not  unique.  Tnere  are  several  Lyapunov  func¬ 
tions  derived  in  tnis  dissertation,  some  of  w.oicn  are 
more  useful  than  others.  There  mav  oe  a  Lvaounov  func- 


y 


tion  that  is  even  setter  suited  for  this  type  of  system. 


There  is  a  need  for  future  research  in  stability 
analysis  of  closed-loop  systems  with  an  observer  in  the 
loop.  The  Lyapunov  functions  should  be  expanded  to  sto¬ 
chastic  systems,  which  have  a  more  practical  meaning. 
Since  the  Lyapunov  function  is  not  unique,  the  develop¬ 
ment  of  a  Lyapunov  function  for  other  aspects  of  system 
performance  (other  than  parameter  uncertainties)  should 
be  considered . 


APPENDIX  A 


INVERSE  OF  DISCRETE  ERROR  COVARIANCE  (P„  ) 

K 


Given  the  discrete  Kalman  filter  equations 


XK+1  "  XK  +  KK[yK  ~  HKxK 


YK  HKXK  +  (/K  '  (/K  ~  N(0,RK' 


(A.  2) 


define 


PK  =  E  [  (xR  -  xR) (xR  -  x K )  A  ] 


?K  =  E[(xr  -  xK)  (xK  -  x K ) 


(A.  3) 


(A.  4) 


Substituting  equations  (A.l)  and  (A. 2)  into  (A. 3) 
results  i r. 


?K  -’(XK  xk  KK(rtKXK+(K  nKXKj) 


*  (xR-xK-KK  (HKxK  +  (/K-HKxK)  )  ] 


(A.  5) 


E  [  i  (I-KkHr)  (xr-xr)-Kr(/r)  (  (I-KRHK)  (xr-xr)-Kr(/r)  ]( A.  6  ) 


w1 


E  (  (I-KkHr)  (xr-xk)  (xr-xk)  *  (I-KrHk)  *  ]  +  E!KkC/k(^K*; 


-  E[Kk(/k  (xk-xk)T(I-KkHk)T] 


E  [  (I-KrHk)  (xk-xr)  ^rKr] 


(A.  7) 


Carrying  through  the  expected  value  and  noting 


that  the  measurement  noise  ( (/  )  is  uncorrelated  with  the 

K 

states,  x  ,  the  result  is  the  Joseph-Buey  form  of  the 
K 

update  equation  for  the  discrete  Kalman  filter 


PR  =  (I  -  KkHk)Pk(I  -  KrHk)T  +  KkRrk£  (A. 8) 


wher  i 


-  =  z.  o  r  *  +0 

K  “K-l * K-l '  *K-2  WK-i 


(A.  9) 


Combining  equations  (A. 8)  and  (A. 9)  results  in 


Define 


PK  =  (!  -  KKHK)Ak.1P;<_1AK_1(I  -  KkHk)^ 


(I  -  KkKk)Qk(I  -  KrHk)T  *  KkRkKr  (A. 10) 


E  s  (  T  -  K  K  1  A 
K  -  1  K  K'  K-l 


(A. 11) 


u  -  KKHK)CK(1  -  KrHk! 


kkrkkk 


( A. 12 ) 


sucn  that  equation  (A. 10)  becomes 


D 

‘  K 


AKPK-1AK  + 


(A. 13) 


The  Lyapunov  function  for  the  observer  is  selected  as 


VK  ^  X K ' 6  K ' K ^  ”  eKPK  eK 


(A. 14) 


where 


p  —Co 

K+l  K“K 


(A. 15) 


PK-1  =  AKPK  AK  +  Qe, 


(A. 16) 


is  derived  oy  developing  as  follows: 


-’K  =  VK  +  1  -  VK 


eT  [  A  -  p-^  1  e 

Kl  K‘K  +  1  K  r  K  J  K 


(A. 17) 


Substituting  equations  (A. 8)  and  (A. 9)  into  equation 


,-l 


(A. 17)  for  ?K  +  1  results  in 


avs  .  eys^;sKPKsJ 


V  1  *  A 

r  K  •  K 


-  v 


(h. 18) 


By  assuming  ( A  „  ,  “  }  is  controllable  and  (A„,E„)  is 


ODservable,  the  system  described  by  equation  (A. 15)  is 

asymptotically  stable.  Therefore,  e  must  converge  tc 

zero  and  A  is  nonsinaular.  Equation  (A. 18)  becomes 
K 

AVk  =  e£[  (P^ft'1^"7)"1  -  P^1]eK  (A. 19) 

Applying  the  matrix  inversion  lemma  to  the  right  side  of 
equation  (A. 19)  results  in 

AVk  =  e^-P^A'1  (^1+A"TP‘1A'1)'1A‘Tp‘1]eK  (A. 20) 

which  is  negative  definite  for  e  *0.  Therefore,  Qo 

_K 

becomes 


( A .  2 1 ) 


APPENDIX  B 


STOCHASTIC  DIFFERENTIAL  /  DIFFERENCE  EQUATIONS 


Continuous-Time  Problems: 


Let  d (x ,t)  be  a  scalar  real  function  continu¬ 
ously  differentiable  in  t  and  having  second  mixed  par¬ 
tial  derivatives  with  espect  to  x,  then  the  differential 
dd  of  d  is 


dd  =  d«.dt  +  d  dx  +  0 . 5tr (GQGTdvv) dt 

L.  X  XX 


for  the  stochastic  differential  equation 


(  B  .  1 ) 


dx  =  f(x,t)dt  +  G(x,t)d|B 


E [ dBde 1 ]  =  Qdt 


(B.2) 


(B.  3) 


Tne  stochastic  differential  equations  for  the 
:losed-loop  system  are 


x  =  (A-BL)x  +  BLe  +  us  ,  ill  _  N(0,Q) 


e  =  (A-KH)  e  -  K(/  +  uu  ,  (/  _  N  (0  ,  R) 


Rewriting  these  equations  in  a  more  general  form 


=  :  (A-3L)  x  BLe]  dt  +  d6 


(B.  5) 


% 

| 

$ 

I 

$ 

I 


$ 

s; 

5i! 


de  =  (A-KH)edt  -  Kd[/  +  dp 
where  dp  =  ui  dt  ,  d(/  =  (/dt. 

p  and  (/  are  brownian  motion  processes  with  the 
proper  ties 

E  [dp]  =  E  [ d (/]  =  0 
E  [dpdBT]  =  Qdt 
E[d(/d(/T]  =  Rdt 
E[dpdC/T]  «  3 

given  the  following  definitions 

X  =  E [xxT] 

S  =  E [ xeT] 

P  =  E [ eeT] 


(B.  7) 

fol lowing 

( B .  8  ) 

( B .  9 ) 

(B. 10) 

(B.ll) 

(B. 12) 

(B.13) 

(B. 14) 


Applying  equation  (B.l)  to  (B.12)  first  results  in 


dX  =  dEfxx  ]  =  Ed[xx  ] 


=  E {  ( [  ( A-BL) x  +  BLe ] dt  +  dp) xT 
+  x  (  [  (  A-BL)  x  +  B  Le  ]  d  t  +  dp)T 

+  dBdpTdt}  ( B . 15) 

Carrying  the  expectation  through,  using  the  definitions 
(  B. 12 ) - (B. 14  )  ,  equation  (B.15)  becomes 

dX  =  [  (A-BL) X  +  X(A-BL)T  +  BLST  +  SLTBT  +  Q]  dt  (B.16) 
which  can  be  rewritten  as 

•  -q  V  m  T  T  T  — 

X  =  =  (A-BL)X  *  X  ( A-BL )  1  +  3LS  +  3L  3  +  Q  (3.19) 

Applying  equation  (B.l)  to  (B.13)  results  in 

dS  =  dE [ xeT]  =  Ed[xeT]  (B.20) 


=  E  {  (  [  ( A-BL)  x  +  BLe  ]  dt  +  dp)e‘ 


+  x  (  ( A-KH )  ed  t  -  Kd(/  +  dp)  T  +  Qdt}  (B.21) 


=  E ( [ ( A-BL) xeT  +  BLeeT] dt  +  dBeT 


+  xeT  ( A-KH)  Tdt  -  xd(/TKT  +  xdeT  +  Qdt>  (B.22) 


Carrying  through  the  expectations,  using  the  definitions 
(  B. 12 ) - ( B . 1 4 )  ,  equation  (B.22)  becomes 


dS  =  [(A-BL)S  +  BLP] dt  +  S(A-KH)xdt  +  Qdt  (B.23) 


which  can  be  rewritten  as 


S  =  ||  =  (A-BL)S  +  S(A-KH)T  +  BLP  +  Q 


Applying  equations  (B.l)  to  (B.14)  results  in 


dP  «  dE[eeT]  =  Ed[eeT] 


=  E  {  [  ( A-KH )  ed  t  -  Kd(/  +  dp]  e' 


+  e  [  (A-KH)  edt  -  Kd(/  +  dp] 


(krkt  j-  Q)dt;- 


=  E{  (A-KH)  ee'dt  -  Kd(/e"dB< 


+  ee1  (A-KH)  ■Ldt  -  ed^K  +  edp1 


+  (KRKT  +  Q ) d  t } 


(arrying  the  expectation  through  results  in 


(B .  2 4  ) 


(B . 25 ) 


(3.26) 


(B. 27) 


LVU'lV  »•» 


dP  =  (A-KH)Pdt  +  P(A-KH)  dt  +  (KRK  +  Q)dt  (B.28) 


which  can  be  rewritten  as 


’  d  P  T  —  T  — 

P  =  jj:  =  (A-KH)P  +  P(A-KH)  +  KRK  +  Q  (B.29) 


Equations  (B.19)  , ( B . 2  4 )  ,  and  (B.29)  are  the  constraint 
equations  for  the  continuous- time  optimization  problem. 


Discrete-Time  Proolem: 


The  stochastic  difference  equations  for  the 
closed-loop  system  are 


XK  +  1  AKXK  +  BKLKSK  +  ,JJK 


;  o  _  y  1/ 

K'K  r'K  +  lVK  +  l 


(B. 30) 


(B. 31) 


where 


AK  -  ak  bklk 


AK  -  AK  KK+1HK+1AK 


_  N  ( 0  ,  Qr  )  ,  i/K  .  N  ( 0  ,  Rr  ) 


(5.32) 


(B. 33) 


(B. 34  ) 


Given  the  following 


XK  -  E  [XKXK 


(B. 35) 


SK  -  E  ^  XKeK1 


(B. 40) 


*3 


%  v 


3K+l  ~  E[XK+leK+l 


(B. 41  ) 


$ 


5^ 


t4KXK  +  3KLKeK  *  '^K1  JAKeK  KK  +  1  ^K  +  l  +  ’“^K ]  h'3,4' 


results  in 


PK  +  1  "  SKPK'^K  +  KK  +  1RK  +  1KK  +  1  +  2K  +  1 


(B. 49 ) 


Equations  (B.39),  (B.44),  and  (B.49)  are  the  constraint 

equations  for  the  d i sc r ete- time  optimization  problem. 


APPENDIX 


LYAPUNOV  FUNCTION  VIA  HAM  I LTON-J ACOB I  EQUATION 


The  performance  index  is  as  follows: 


J  =  x f Gf x  f  +  e f Tf e  f 


+  J  /  <x\x  +  eTQee  +  uTR  u)dt 


subject  to 


x  =  Ax  +  Bu 


e  =  ( A  -  KH) e 


(C.  1 


(C.  2 


3 


where 


u  =  -Lx  =  -L(x-e)  =  u  +  Le  (C.4 

L  =  (C.5 

★ 

and  u  is  the  optimal  control  . 

Define  tne  Lyapunov  function  as  the  optimal  return  func 
tion 


V 


x 


+ 


'T 

eV^e 


min  •'  J  ; 
★ 
u 


(C.6 


Using  these  equations  and  tne  H3mil ton-Jacobi  equation 


"Ft  = 


m  1  n  i  H  ; 

★ 

u 


(C.  7) 


where  H  (  the  Hamiltonian  )  is  represented  oy  tne  par¬ 
tial  differential  equation: 


H 


_  Fj° 

“  “FT 


X 


e 


T  T 

+  xQx  +  eQe  + 
c  e 


uaR.u 

c 


(C.  8) 


and  /vj  are  derived  by 
equating  like-terms  in  equation  (C.7).  First,  solving 
equation  (C.8)  results  in 


the  differential  equations  for 


H  =  2xTAx (Ax  +  Bu)  +  2eTAp  ( A-KH ) e 

T  T  T 

+  x  Q^x  +  e"2ee  +  u~Ru  ( C .  9 ) 

Tne  minimization  with  respect  to  u  is  accom¬ 
plished  by  making  the  following  substitution  from  (C.4) 

u  =  -RZ1BTAxx  +  Le  (C.10) 


Therefore 


WVVWV 


’AVf.'lVij'i.'l 


min{H}  =  xTA^Ax  +  xTA1/'>,x  -  2xTAxBR„i  B^^x 
u 


+  2x  A^BLe  +  e  ApAe  +  e  A  Ape  +  x  Qcx 


+  eTQee  +  (Le-R^B^x)  TRc  (Le-R^B^x)  (C.ll) 


where  A  =  A  -  KH 


Tne  left  hand  side  of  equation  (C.7)  is 


bj  vt;  ^  t: 

5T  =  SV*  eV 


(C. 12) 


Equation  (C.ll)  and  (C.12)  are  substituted  in  Equation 
(C.7)  . 


•Ji  •  <p  *  m  rj-  rjtrj-i 

0  =  x  A^x  +  e  Ape  +  e  /^e  +  x  A^Ax  +  x  AVs^x 


rp  »Ti  rp  rn  ji  rp 

x * L  R„ Lx  +  eVSpAe  +  e  A  Ape  +  x^cx 


T  T  T 

+  e  Q  e  +  e  L  R  Le 
e  c 


0  =  xX  +  \A  *  A%  -  LTRcL  +  Qc}x 


+  ApA 


ST/\o  +  LTR„L  +  Qq  }  e 


k 


1 


iSSB 


Ji*Al.>»*.fatA* jM  i|>  jj jj  j»|«  i 


This  leads  to  the  following  differential  equations. 


■\  -  AA  -  A\  *  lTrcl  -  o< 


Ap  =  -ApR  -  RTAp  -  ltrcl  -  Qe  (C.16) 


Using  equation  (C.5),  the  differential  equation 


for  can  be  rewritten  as 


-  AA  -  h\  -  lTrcl  -  Qc 


(  C  .  1 7  ) 


where  A  =  A  -  BL 


Thus,  equations  (C.16)  and  (C.17)  are  the  same  as  those 
derived  in  Section  III. 


With  parameter  uncertainty  in  the  dynamic  equations, 
equations  (C.2)  and  (C.3)  are  written  as 


x  =  A  '  x  +  B  1  u 


e  =  Dx  +  A ’ e 


(C. IS) 


<  C . 19) 


where 


( C  .  2 1 ! 


‘/vWtN 


A  =  -  K  H  +  ( B-3„ ) L  -  K^(M-M„}L  (C.22) 

^  CC  ^  C  ^  w  C 


D  =  ( A-A  )  -  K„  { H-H„ )  -  ( B-B  „ ) L  +  K  (M-M„)L  (C.22) 

s-  wCCCC 

Using  equations  (C.18)  and  (C.19),  the  Hamilton-Jacobi 
equation  (C.7)  becomes 


rp  •  rn  •  rp  •  rp  rp 

0  =  x  /^x  +  x  Age  +  E  / \gX  +  E  Ape 


rp  rp  rp  T>  rp  rn  rn 

-V  '  xAB’Lc,i  -  *  LcB  -V 


rp  rp  rp  rp  rp  rp  HP—  rp 

+  xiAxB,Lce  +  e  LZB’VSjjX  +  eV^A'x  +  x^A'V^e 

T  T  TTT1  rp  rp  rp  rp  rp  rn 

-  eiAsB'Lcx  -  x 1 LYB  '  /\,e  +  e  V\2B '  L^e  +  e  LIB’V^e 


f  xV\gDx  +  xTDT/\Ex  +  eV-pDx  +  xTDT^e  +  xVvgA'e 


e*S'Y^x  +  e\s'e  -r  eY.’V^e  +  x^Q^x  +  eT( 


*p  *p  TT  rp  rp  TT 

+  x  L„R„L„x  -  x  L/R  L  e  -  e  *  L/R„  L„x  +  e  AYR  L  e  (  C .  24  ) 

^  V  C  w  ^  ^  C  C 

Collecting  xT{  }x,  xT{  }e,  and  e"{  }e  terms  while  noting 


B=  -  AB'A 


(C. 25) 


results  in 


m 

KM 

KM 

ft 


w" 
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